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DATA COMMUNICATIONS SYSTEM 

Background of the Invention 
Field of the Invention 

5 The present invention relates to a data 

communications system for implementing a service for 
communicating data with a prescribed cyclical 
structure, such as animation data , etc., in high quality 
via a communications network adopting a datagram type 

10 communications protocol, such as the Internet, etc. 

As a standard for synchronously communicating 
animation data, such as digital video, etc. , in a local 
bus, for example, IEEE13 94 standard by IEEE (Institute 
of Electrical and Electronics Engineering) is used. 

15 Recently, with the spread of both equipment , such 

as a digital video camera, etc. , and a high-performance 
personal computer to a general user, for example, a 
technology for connecting local networks configured 
according to the IEEE1394 standard to each other, for 

20 example, via the Internet and for relaying a data stream 
generated based on the standard of each local network 
is highly demanded. 

The present invention is not limited to the 
Internet or IEEE1394 standard. 
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Description of the Related Art 

One frame, which is the basic element of digital 
video data includes one frame of both video data and 
audio data and is composed of ten DIF sequences, as 
5 shown with serial numbers in Fig. 1A. 

Each DIF sequence is composed of 150 DIF blocks 
and has a structure where a regular pattern consisting 
of 15 pieces of video data (v) continuing after one 
piece of audio data (a) following six frame header 
10 information (f ) , is repeated, as shown in Fig. IB. 

Each DIF block is composed of 77 bytes of data 
and three bytes of identification information, as shown 
in Fig. 1C. 

The data structure shown in Fig. 1 indicates the 
15 logical format of digital video data, and when digital 
video data are transmitted in a real network, a format 
suitable for the characteristic of the network is 
adopted . 

For example, if digital video data are 
20 transmitted via a local bus based on the IEEE1394 
standard, an IEEE1394 packet is generated by attaching 
both a prescribed header (CIP (Common Isochronous 
Packet) header and synchronous (ISO) header) and CRC 
to six DIF blocks , as shown in Fig . 2A and digital video 
25 data are transmitted in transfer units of these IEEE1394 
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packets . 

In this case, since each DIF sequence is divided 
into 25 IEEE 1394 packets, as shown separated by vertical 
bars in Fig. IB, one frame of digital video frame is 
5 transmitted as 250 IEEE1394 packets, as shown in Fig. 
2B. 

Therefore, the combination of DIF blocks 
included in each IEEE1394 packet has regularity, as 
shown in Fig. 2C. A repetition pattern shown with an 

10 arrow mark in Fig. 2C indicates the variation pattern 
of the combination of a DIF block (a) with audio data 
and a DIF block (v) with video data in eight IEEE1394 
packets No. 1 through No. 8, and these IEEE1394 packets 
correspond to the shaded part of a DIF sequence shown 

15 in Fig. IB. 

As is clearly known from the regularity in the 
array of DIF blocks in the DIF sequence described above, 
the same repetition pattern appears in both IEEE1394 
packets No. 9 though No. 16 and IEEE1394 packets No. 

20 17 through No. 24 shown in Fig. 2. 

According to the IEEE1394 standard, since it is 
stipulated that 8,000 IEEE1394 packets should be 
transmitted per second in a synchronous transfer mode, 
30 frames of video and audio data can be reproduced 

25 per second via audio/visual equipment connected to a 
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local bus, such as a display device, a speaker, etc. 

Therefore, a first network and a second network 

which are connected by a local bus based on the IEEE1394 

standard can also be connected via a third network of 
5 another type, and the IEEE1394 packets described above 

can also be theoretically transmitted/received 

between them. 

A data communications system using such a gateway 

is also proposed. 
10 For example, a data communications system is 

proposed by the Principle/Media Laboratory and 

Environmental Information Department of Keio 

University (Kazunori Sugiura et al., "Internet DV 

Transfer Technology Using Frame -Exclusive Technology' 7 , 
15 The Institute of Electronics, Information and 

Communication Engineers, Technical Report of IEICE, 

CPSY99-33, p. 71-81 (May 1999). 

As shown in Fig. 3, this data communications 

system comprises a gateway 10 for relaying data between 
20 a first network based on the IEEE1394 standard and the 

Internet, and a gateway 20 for relaying data between 

a second network based on the IEEE1394 standard and 

the Internet. 

In Fig. 3, an IEEE1394 packet transmitted to the 
25 first networkbya digital video camera lis transferred 
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to a digital video transmitting unit (DV transmitting 
unit) 12 via an IEEE1394 adapter 11. 

A frame thinning- out process is performed by this 
digital video transmitting unit 12. Simultaneously, 
5 as shown in Fig. 4, header information consisting of 
an IP header, UDP (User Datagram Protocol) and an 
application header is attached to an IEEE1394 packet 
to be transmitted, and a packet encapsulated in an IP 
packet is transmitted to the Internet via an Internet 

10 adapter 413. 

In this way, the IP-encapsulated packet is 
transferred to a digital video receiving unit (DV 
receiving unit) 21 via an Internet adapter 13 and is 
decapsulated by this digital video receiving unit 21. 

15 Then, the packet is transmitted to the second network 
via an IEEE1394 adapter 11. 

In this way, for example, pictures and voice that 
are taken by the digital video camera 1 connected to 
the first network can be transferred to the second 

2 0 network via the Internet and can be recorded/ reproduced 
by a digital video deck 2 connected to the second 
network . 

In this data communications system, an 
application header, including both an adjustment 
25 parameter for indicating information about frame 
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thinning-out, etc., and a sequence number is attached 
in the encapsulation process by the digital video 
transmitting unit 12, and an IEEE1394 packet stream 
is reproduced according to information in this 
5 application header in the decapsulation process by the 
digital video receiving unit 21. 

The data communications system shown in Fig. 3 
simply encapsulate digital video data in a UDP packet 
and transmits the data, and information inserted in 

10 the application header when data are encapsulated is 
limited to a few items, such as a sequence number, etc. 

For the details of both the frame thinning-out 
process and IEEE1394 packet stream reproduction 
process of this data communications system, see the 

15 reference described above. 

In the data communications system described 
above, UDP is adopted as the communications protocol 
of the transport layer of the Internet, and each 
IEEE1394 packet composing the IEEE1394 packet stream 

20 in the first network is transferred to the second 
network via the Internet as datagram. 

Since UDP is connectionless type communication 
protocol, broadcast type communications in which one 
sender can simultaneously transmit the same data to 

25 many receivers, can be conducted. Therefore, UDP is 
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suited to transmit/receive data between the first and 
second networks via the Internet. 

However, since UPS is provided only with an error 
detection mechanism as far as a mechanism for 
5 maintaining transfer quality is concerned; the loss 
and redundancy of an IP-encapsulated packet, the 
modification of an arrival order on the receiving side, 
etc., must be coped with by an application software 
program on both the transmitting and receiving sides. 

10 In this way, sufficient information about the 

loss and redundancy of each packet, the modification 
of an arrival order, etc., cannot be obtained on the 
receiving side simply by encapsulating digital video 
data in an UDP capsule as in the data communications 

15 system shown in Fig. 3. Therefore, when the digital 
video data are reproduced, there is the possibility 
that there may be some failure and thereby sufficient 
communication quality cannot be expected. 

For example, if a packet stream is synchronously 

20 communicated between a sender and a receiver in an 
IEEE1394 synchronous communications mode described 
above, transfer delay between the sender and receiver 
must also be kept constant. 

However, in a "best-ef f ort " type network, such 

25 as the Internet, both transfer rate and transfer delay 



if / / 



8 



vary depending on the traffic of a network and 
simultaneously, transfer delay on the receiving side 
greatly varies depending on the loss and redundancy 
of an IP-encapsulated packet. 
5 Besides, the occurrence probability of the loss 

and redundancy of a packet, etc., varies depending on 
the traffic of a network. 

Therefore, to implement the transmission of 
packet streams in an IEEE1394 synchronous 

10 communications mode via a network adopting a datagram 
type communications protocol, such as the Internet, 
etc., a technology for controlling transfer delay as 
well as a technology for improving transfer quality 
between a sender and a receiver are required. 

15 For example, communications between local 

networks can be implemented via the Internet regardless 
of a physical distance between the local networks by 
providing each of a plurality of local area networks 
with a router or gateway and by connecting this router 

20 or gateway to the Internet. 

Fig. 5 shows an example of the configuration of 
a data communications system configured by connecting 
a plurality of local area networks using gateways. 

In the data communications system shown in Fig. 

25 5, personal computers (PC) 21a, 21b and 21c connected 
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to a first LAN, a second LAN and a third LAN , respectively, 
and gateways 22a, 22b and 22c are connected, for example , 
according to the communications protocol of a network 
layer, such as an IP protocol, etc. 
5 If the communications protocols of the network 

layers between terminals in which data are relayed using 
both gateways and the Internet are unified, 
communications between personal computers 21a, 21b and 
21c can be implemented regardless of the communications 
10 protocols of a data link layer adopted in the first, 
second and third LANs. 

However, the IEEE1394 standard is focussed on 
as a high-speed interface for connecting audio/visual 
equipment, such as a digital video camera, etc., to 
15 a personal computer. 

This IEEE1394 standard is a high-speed serial 
bus standard that is stipulated around both a physical 
layer and a data link layer, and stipulates a function 
to consecutively transfer a prescribed transfer unit 
20 in a specific cycle (synchronous transfer mode) and 
a function to transfer a control command from time to 
time to control equipment, such as a digital video 
camera, etc. (asynchronous transfer mode) . 

According to the IEEE1394 standard, n 
25 synchronous transfer channels and an asynchronous 
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transfer packet transfer time coexist in one cycle 

(125)13), as shown in Fig. 6A. 

If data are transferred in a synchronous transfer 
mode, a node on the transmitting side requests a bus 
5 management node of an isochronous channel, and then 
a synchronous transfer channel depending on the 
transfer rate is assigned by the bus management node 
or a channel ID for identifying an aisochronous channel 
is provided. 

10 If particularly, animation data with audio data 

are transferred in real time in a synchronous transfer 
mode, the transmitting side node attaches a CIP (Common 
Isochronous Packet) header to transfer data in addition 
to a synchronous header, including the channel ID 

15 described above, generates an aisochronous packet 
shown in Fig . 6B and transmits the assigned aisochronous 
channel. A receiving side node identifies a packet to 
be received based on the channel ID included in the 
aisochronous packet and receives the transfer data. 

20 The CIP header is provided with 16 bits of a time 

stamp field, and when transferring digital video data, 
the transmitting side node writes a time stamp for 
indicating a transmission time in one of a series of 
packets composing one frame of video data . The receiving 

25 side node adjusts timing based on this time stamp. 
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In this way, in the synchronous transfer mode 
of the IEEE1394 standard, an individual communications 
is identified by the channel ID included in the 
synchronous header, and data can be transferred while 
being synchronized by adjusting timing based on the 
time stamp in the CIP header regardless of the number 
of receiving side nodes. 

However, in asynchronous transfer mode, after 
obtaining a right to use a bus, a transmitting side 
node generates an asynchronous packet (see Fig. 6C) 
by attaching an asynchronous header, including 
respective node IDs for indicating a transmitting node 
and a receiving node to transfer data, and transmits 
the packet to a bus. 

Then, a receiving side node receives the packet 
addressed to him/her based on a receiving ID included 
in the header and transmits a reply packet (shown by 
symbol "ack" to a bus within a prescribed time period 
in Fig. 6A) . 

In this way, in an IEEE1394 asynchronous transfer 
mode, an individual communications is identified by 
the combination of a source ID and a destination ID 
included in the asynchronous header, and the arrival 
of a packet with transfer data is confirmed by a 
prescribed reply packet returned by the receiving side 
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node. - 

As a data communications system for implementing 
the transmission/reception of an IEEE1394 packet by 
connecting first and second networks that are connected 
5 to each local bus based on the IEEE1394 standard 
described above via a third network of another type, 
the data communications system described above that 
is proposed by the Principle/Media Laboratory and the 
Environmental Information department of Keio 

10 University is used. 

Since the existing router is configured 
presuming that networks should be connected even in 
the case of the protocol of a data link layer or a layer 
lower in hierarchy than a data link layer of a relay 

15 network, information transmitted/received between 
functions of a data link layer or less in an individual 
network is not used. 

However, the information of this data link layer 
cannot be used simply by encapsulating a packet 

20 transferred in an individual network, including 
information about the functions of a data link layer 
or less. 

This is because the information of a data link 
layer is peculiar to an individual network, it is 
25 presumed that a transmitting node and a receiving node 
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belong to one network and it is not presumed that each 
of the transmitting and receiving nodes belongs to a 
different network . 

For example, according to the IEEE1394 standard, 
5 bus reset is caused by the addition of a new node, etc. , 
and each time, a node ID is provided to each node 
belonging to the network according to prescribed 
procedures . 

In this case, a node ID provided to each node 

10 is not always the same ID provided before the bus reset . 
There is the possibility that the aisochronous channel 
ID may also be modified. 

If each of a transmitting node and a receiving 
node belongs to a different network, timing cannot be 

15 adjusted using a time stamp indicating a time in the 
network on the transmitting side without any 
modification on the receiving side even if the time 
stamp is written in the CIP header of a synchronous 
transfer mode and is transferred to the receiving node . 

20 However, since the IEEE1394 standard presumes 

that a receiving node exists within a prescribed cable 
length, a time allowed until a reply packet is returned 
to an asynchronous packet is very short. 

Therefore, if the reply packet is transmitted 

25 after an asynchronous packet is actually received, 
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delivery confirmation cannot be normally completed in 
an asynchronous transfer mode. 

In addition to the above, there are the following 
problems . 

A) Essentially one communications must be divided into 
a plurality of communications depending on the usable 
band of a network and each of the divided 
communications must be transferred via a different 
route as a respective independent communications. 

B) The delay of data transferred by one sender with a 
plurality of different communications delay must be 
adjusted and synchronized on the receiving side. 

C) The delay of data transferred by a plurality of 
senders with a plurality of different communications 
delay must be adjusted and synchronized on the 
receiving side. 

Summary of the Invention 

It is an object of the present invention to provide 
both a data communications system for transmitting data 
with a known data structure in high quality and for 
transmitting such data while controlling the transfer 
delay of data with a known data structure in a data 
communications system for communicating via a network 
adopting a datagram type communications protocol. 
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It is another object of the present invention 
to provide a data communications system for providing 
information sufficient to reproduce digital video data 
from each transfer unit on the receiving side by 
attaching additional information to each transfer unit 
composing digital video data and transferring the 
information as a UDP packet. 

It is another object of the present invention 
to provide a data communications system for 
transferring data theoretically regarding a first 
network and a second network as one network regardless 
of the physical locations using information peculiar 
to both the first network, including a transmitting 
node and the second network, including a receiving node . 

It is another object of the present invention 
to provide a data communications system for 
transmitting data with a known data structure among 
a plurality of physically independent networks via a 
relay network adopting a datagram type communications 
protocol . 

It is another object of the present invention 
to provide both a system and a method for synchronizing 
and receiving a plurality of communications on the 
receiving side . 

The basic concept of the present invention is 
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a data communications system for implementing a 
synchronous communication in which data are 
consecutively transferred at a specific transfer rate 
and with a specific transfer delay using a 
5 communications network in which data may be lost, 
redundant data may be transferred and a data transfer 
order may be modified and which is configured in such 
a way that synchronous communications data can be 
transferred from the transmitting side with 
10 information about the data and that the synchronous 
data can be reproduced by using the information about 
the synchronous communications data on the receiving 
side . 

The additional configurations of the present 
15 invention are as follows. 

(1) As information about synchronous 
communications data, the transmission 
order of the data is used. 

(2) As information about synchronous 
20 communications data, a data processing time 

on the transmitting side is used. 

(3) If synchronous communications data have a 
cyclical structure with a fixed length, for 
information about the data, both a number 

25 for indicating a cycle and a number for 
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indicating an order in a specific cycle are 
used . 

(4) As information about synchronous 
communications data, a symbol for 
5 indicating a data processing method on the 

transmitting side is used. 
According to the first data communications 
system of the present invention, in a data 
communications system in which a transmitting side 
10 relay device and a receiving side relay device are 
connected to the first and second networks, 
respectively, for consecutively transferring 
prescribed transfer units at a specific transfer rate 
and with a specific transfer delay, and in which a data 
15 stream generated as a series of the transfer units is 
communicated as a series of datagram type packets, 
including the transfer unit, via the third network, 
the transmitting side relay device comprises 
additional information generation means for 
20 generating additional information, including 
information about relationship between each transfer 
unit and the data stream, based on the characteristics 
of the data stream, packet generation means for 
generating a packet by attaching the additional 
25 information when each transfer unit composing the data 
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stream is inputted and by also attaching header 
information suitable for transfer in the third network 
and transmitting means for transmitting the packet to 
the third network according to prescribed procedures . 
The receiving side relay device comprises separation 
means for separating the additional information from 
the transfer unit , both of which are included in a packet 
received via the third network, analysis means for 
analyzing the additional information separated by the 
separation means, reproduction means for reproducing 
the data stream by locating a plurality of pieces of 
information included in the transfer unit received from 
the separation means in respective appropriate 
positions in the data stream, based on the analysis 
result of the analysis means and output means for 
outputting the data stream reproduced by the 
reproduction means to the second network. 

According to the second data communications 
system of the present invention, in a data 
communications system in which a transfer unit of a 
prescribed type transferred in the first network, which 
is one of a plurality of independent networks, is 
relayed by a transmitting side relay device installed 
in relation to the first network, another relay network 
and a receiving side relay device installed in relation 
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to the second network, which is at least one of other 
independent networks, the transmitting side relay 
device comprises extraction means for extracting a 
transfer unit to be transmitted to the second network, 
5 transformation means for applying a prescribed 
operation to control information included in the 
extracted transfer unit and generating a relay transfer 
unit, reshaping means for reshaping the relay transfer 
unit into a packet in a format suitable for transmission 

10 procedures in the relay network and addressed to the 
receiving side relay device installed in relation to 
the second network and first transmitting means for 
transmitting each packet reshaped by the reshaping 
means to the relay network. The receiving side relay 

15 device comprises separation means for separating the 
relay transfer unit by breaking down the packet received 
via the relay network, generation means for applying 
a prescribed operation to the relay transfer unit 
obtained by the separation means and regenerating a 

20 transfer unit, including control information suitable 
for the transmitting process of the second network and 
second transmitting means for transmitting the 
transfer unit generated by the generation means to the 
second network. 

25 According to the third data communications 
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system of the present invention, in a data 
communications system in which transmitting side relay 
means installed in relation to the first network, which 
is one of a plurality of physically independent networks 
for transferring structure data with a prescribed 
regular structure in prescribed transfer units 
transmits a transfer unit to be transferred in the first 
network to another relay network, and receiving side 
relay means installed in relation to the second network, 
which is one of the plurality of independent networks, 
relays the transfer unit transmitted to the relay 
network to the second relay network, the transmitting 
side relay means comprises generation means for 
generating a datagram type relay packet, including the 
transfer unit, addressed to the receiving side relay 
means, when the transfer unit transferred in the first 
network is inputted and transmitting means for 
transmitting the relay packet to the relay network. 
The receiving side relay means comprises separation 
means for separating the transfer unit by breaking down 
the relay packet received via the relay network, 
reproduction means for reproducing the structure data 
from the transfer unit obtained by the separation means , 
based on information about the prescribed regular 
structure for the structure data to be provided and 
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transmitting means for transmitting the structure data 
to the second network in the prescribed transfer units . 

The fourth system of the present invention is 
a system for communicating via a plurality of network 
5 routes with a plurality of pieces of different 
communications delay, and comprises transmitting 
means for transmitting a plurality of divided 
communications data with additional information for 
split communications via the plurality of network 

10 routes, and receiving means for uniting, synchronizing 
and receiving a plurality of divided communications 
data based on the additional information. 

According to the first data communications 
system of the present invention, the transmitting side 

15 relay device can transmit a data stream to be 
transferred in the first network to another third 
network as a packet with appropriate additional 
information for each transfer unit, and the receiving 
side relay device can reproduce a data stream equivalent 

20 to the data stream in the first network from these 
packets and can transmit the data stream to the second 
network. 

In this way, since data transmission with the 
high degree of freedom is available between at least 
25 one terminal device connected to the first network and 
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at least one terminal device connected to the second 
network, a variety of communications services can be 
provided . 

According to the second data communications 
5 system, a plurality of physically independent networks 
can be connected via a relay network and data can be 
transmitted to the second network, which is one of other 
independent networks, after performing an operation 
necessary for control information included in a 

10 transfer unit to be transferred in the first network, 
which is one of a plurality of independent networks. 
Therefore, a transfer unit can be transmitted regarding 
these independent networks as one virtual network while 
taking into consideration roles played by control 

15 information in the first and second networks. 

According to the third data communications 
system, structure data with a known structure to be 
transferred in the first network can be relayed to the 
second network side via a relay network and the data 

20 can be reproduced using information about the structure . 
In this way, structure data transmitted by a node 
belonging to the first network according to synchronous 
communications procedures can be transmitted to a node 
belonging to the second network with the original data 

25 structure maintained, and a variety of services can 
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be provided, regardless of the 

scale of each network, the physical distance between 
networks, etc. 

According to the fourth system, communications 
5 data that require synchronous control can be 
transmitted via a plurality of network routes with a 
plurality of pieces of different communications delay. 
Therefore, if large-capacity communications data, 
such as animation, a three-dimensional picture, etc. , 
10 are transmitted, the receiving side can receive such 
communications data while securing synchronization 
even if there is no sufficient band in a single network 
route . 

15 Brief Descriptions of the drawings 

Fig. 1 shows the format of digital video data. 

Fig. 2 shows a data structure in the case where 
DV data are transferred in an IEEE 1394 synchronous mode . 

Fig. 3 shows a system configuration used in an 
20 animation communications experiment. 

Fig. 4 shows a format in the case where DV data 
are transmitted using a UDP. 

Fig. 5 shows an example of the configuration of 
data communications system connected to a plurality 
25 of LANs. 
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Figs. 6A through 6C show an interface of the IEEE 
standard. 

Fig. 7 shows the configuration of the data 
communications system in a preferred embodiment of the 
5 present invention. 

Fig. 8 shows the basic configuration of the data 
communications system in another preferred embodiment 
of the present invention. 

Fig. 9 shows the basic configuration of the data 
10 communications system in another preferred embodiment 
of the present invention. 

Fig. 10 shows the basic configuration of the data 
communications system in another preferred embodiment 
of the present invention. 
15 Fig. 11 shows the detailed preferred embodiment 

of the data communications system of the present 
invention . 

Fig. 12 shows the detailed configuration of a 
DV/IP transmitting unit. 
20 Fig. 13 shows the structure of additional 

information . 

Fig. 14 is a flowchart showing the operation of 
transmitting a DV/IP capsule. 

Fig. 15 shows the operation of redundantly 
25 transmitting packets. 
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Fig. 16 shows the detailed configuration of a 
DCV/IP receiving unit. 

Figs. 17A and 17B show a receiving buffer unit 
and a block counter unit, respectively. 
5 Figs. 18A and 18B are flowcharts showing the 

receiving operation and reproduction operation, 
respectively, of a DV/iP packet. 

Figs. 19A through 19C show the reproduction 
operation of DV data. 
10 Fig. 20 shows the configuration of the data 

communications system corresponding to that shown in 
Fig. 10. 

Fig. 21 shows both the detailed configuration 
of an IP transmitting control unit and an example of 
15 another configuration of a DV/IP transmitting unit. 

Fig. 22 is a flowchart showing the operation of 
transmitting a DV/IP packet. 

Fig. 23 shows relationship between a DV/IP 
receiving unit and a control packet processing unit. 
20 Fig. 24 shows examples of other respective 

configurations of both an integrity judgment unit and 
a delay adjustment unit. 

Figs. 25A and 25B are flowcharts showing the 
receiving and reproduction operations, respectively, 
25 of a DV/IP packet. 



Figs. 26A through 26C show both data writing and 
reproduction operations depending on a transmission 
mode . 

Fig . 27 shows the transmitting/ receiving control 
operations by the transmission/reception of a control 
packet . 

Fig. 28 shows the basic configuration of the data 
communications system in a preferred embodiment of the 
present invention . 

Fig. 29 shows the basic configuration of the data 
communications system in another preferred embodiment 
of the present invention. 

Fig. 30 shows the basic configuration of the data 
communications system in another preferred embodiment 
of the present invention. 

Fig. 31 shows the preferred embodiment of the 
data communications system of the present invention. 

Fig. 32 shows the relay operation of a synchronous 
packet . 

Fig. 33 shows both the conversion and reshaping 
processes of a synchronous packet. 

Figs. 34A and 34B show a channel ID table. 

Fig. 35 shows another preferred embodiment of 
the data communications system of the present 
invention . 
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Fig. 36 shows the basic configuration of the data 
communications system in a preferred embodiment of the 
present invention . 

Figs. 37A through 37D show the relay operation 
5 of a synchronous packet. 

Fig. 38 is a flowchart showing the editing 
operation of a transmitting packet. 

Fig. 39 is a flowchart showing the editing 
operation of a receiving packet. 
10 Fig. 40 shows the basic configuration of the 

invented system in another preferred embodiment of the 
present invention . 

Fig . 41 shows the detailed configurations of both 
transmitting packet editing and receiving packet 
15 editing units. 

Figs. 42A through 42C show a node ID table. 

Fig. 43 shows the relay operation of an 
asynchronous packet . 

Figs. 44A through 44C show the relay operation 
20 of an asynchronous packet. 

Fig. 45 is a flowchart showing an operation 
corresponding to bus reset. 

Fig. 46 shows an operation in the case where there 
is bus reset. 

25 Fig. 47 shows the basic configuration of the data 
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communications system in a preferred embodiment of the 
present invention . 

Fig. 48 shows the basic configuration of the data 
communications system in another preferred embodiment 
5 of the present invention. 

Fig. 49 shows the basic configuration of the data 
communications system in another preferred embodiment 
of the present invention. 

Fig. 50 shows the configuration of the preferred 
10 embodiment of the data communications system of the 
present invention . 

Fig. 51 shows the detailed configuration of a 
digital video transmitting unit. 

Fig. 52 shows the detailed configuration of a 
15 digital video receiving unit. 

Figs. 53A and 53B are flowcharts showing both 
the packet generation and packet transmitting the 
operations of a DV transmitting unit. 

Figs. 54A and 54B show a transmission interval 
20 adjustment operation. 

Fig. 55 is a flowchart showing the reproducing 
operation of digital video data. 

Figs . 56 A and 56B show the reproducing operation 
of digital video data. 
25 Fig. 57 shows the configuration of another 
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preferred embodiment of a digital video data receiving 
unit . 

Fig. 58 is a flowchart showing the output 
To operation of digital video data. 
5 Figs. 59A and 59B show the output operation of 

digital video data. 

Figs. 60A through 60C show problems caused in 
the actual application of the preferred embodiments 
described above. 
10 Fig. 61 shows the general configuration of a relay 

device . 

Fig. 62 shows problems of the preferred 
embodiments described above. 

Fig. 63 shows the split communications of DV. 
15 Fig. 64 shows the transmitting relay device in 

one preferred embodiment of the present invention. 

Fig. 65 shows a receiving relay device in order 
to show how the communications delay of a single sender 
is adjusted. 

20 Fig. 66 shows how the communications delay of 

a plurality of senders. 

Fig. 67 shows the configuration of a transmitting 
relay device for synchronizing and transmitting data 
using a sequence number on the transmitting side. 

25 Fig. 68 shows a device for synchronizing and 
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integrating the communications data of a plurality of 
senders on the receiving side. 

Fig. 69 shows another configuration for 
synchronizing and integrating a plurality of pieces 
5 of communications data from a plurality of senders on 
the receiving side. 

Fig. 70 shows the configuration of a receiving 
relay device in the case of a plurality of senders. 

Fig. 71 shows the synchronous configuration in 
10 the case of a plurality of senders and a plurality of 
receivers . 

Fig. 72 shows the configuration of a receiving 
relay device in the case where a synchronization device 
is used. 

15 Fig. 73 shows the influence of the dynamic change 

of an effective available band in split communications 
(No. 1) . 

Fig. 74 shows the influence of the dynamic change 
of an effective available band in split communications 
20 (No. 2) . 

Fig. 75 shows a transmitting relay device for 
dynamically modifying a division method using network 
information . 

Fig. 76 shows the configuration of a transmitting 
25 relay device for preventing a small change in network 
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information from being reflected on a data division 
principle . 

Fig. 77 shows the detailed configuration of the 
data communications system. 
5 Fig. 78 shows a configuration for synchronizing 

and receiving a plurality of pieces of data based on 
additional information on the receiving side. 

Description of the Preferred Embodiments 

10 Fig. 7 shows the configuration of the data 

communications system. 

According to the first preferred embodiment of 
the present invention, in a data communications system 
in which a transmitting side relay device 110 and a 

15 receiving side relay device 120 are connected to the 
first and second networks, respectively, for 
consecutively transferring prescribed transfer units 
at a specific transfer rate and with a specific transfer 
delay, and a data stream generated as a series of the 

20 transfer units are communicated as a series of datagram 
type packets, including the transfer unit via the third 
network, the transmitting side relay device 110 
comprises additional information generation means 111 
for generating additional information, including 

25 information about relationship between each transfer 
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unit and the data stream based on the characteristics 
of the data stream, packet generation means 112 for 
generating a packet by attaching the additional 
information when each transfer unit composing the data 
5 stream is inputted and by also attaching header 
information suitable for transfer in the third network 
and transmitting means 113 for transmitting the packet 
tot he third network according to prescribed procedures . 
The receiving side relay device 120 comprises 

10 separation means 121 for separating the additional 
information from the transfer unit, both of which are 
included in a packet received via the third network, 
analysis means 122 for analyzing the additional 
information separated by the separation means 121, 

15 reproduction means 123 for reproducing the data stream 
by locating a plurality of pieces of information 
included in the transfer unit received from the 
separation means 121 in appropriate positions in the 
data streambased on the analysis result of the analysis 

20 means 122 and output means 124 for outputting the data 
stream reproduced by the reproduction means 123 to the 
second network. 

According to the configuration, a packet with 
both a transfer unit and additional information about 

25 the transfer unit can be transmitted by the additional 
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information generation means 111, the packet 
generation means 112 and transmitting means 113 ofboth 
the transmitting side relay device 110 and the receiving 
side relay device 120, the original data stream can 
5 be reproduced by the analysis means 122 for analyzing 
additional information separated by the separation 
means 121 and the reproduction means for locating each 
transfer unit based on the analysis result. 

In the data communications system, the 

10 additional information generation means 111 can also 
generate additional information, including a sequence 
number for indicating the transmission order of each 
transfer unit. 

Furthermore, by the additional information 

15 generation means 111 for generating additional 
information, including a sequence number in each 
transfer unit, attaching this additional information 
to a corresponding transfer unit and transmitting the 
transfer unit, the arrival state can be checked based 

20 on this sequence number on the receiving side. 

In the data communications system, the 
additional information generation means 111 can 
generate additional information, including a time 
stamp for indicating the transmission time of each 

25 transfer unit. 
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In this case, by the additional information 
generation means 111 for generating additional 
information, including a time stamp in each transfer 
unit, attaching this information to a corresponding 
5 transfer unit and transmitting the transfer unit, the 
original data stream can be reproduced using this time 
stamp . 

In the data communications system, since a data 
stream transferred in the first and second networks 

10 has a prescribed cyclical structure, the additional 
information means 111 can generate additional 
information, including both a cycle to which each 
transfer unit belong, and a number for indicating an 
order in the cycle, based on the cyclical structure 

15 possessed by the data stream. 

In this case, since the additional information 
generation means 111 generates additional information, 
including information about a position occupied by the 
transfer unit in the cyclical structure of the data 

20 stream, in each transfer unit, this information is 
attached to a corresponding transfer unit and the 
transfer unit is transmitted, the original data dream 
can be reproduced using this information about the 
position . 

25 In the data communications system, since a data 
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stream transferred in the first and second networks 
is digital video data, the additional information 
generation means 111 can generate additional 
information, including both a frame number for 
5 indicating each video frame composing digital video 
data and a data block number for indicating a data block 
composing the video frame. 

In this case, since the additional information 
generation means 111 generates additional information, 

10 including both the relevant frame number and block 
number for each transfer unit composing digital video 
data, this information is attached to a corresponding 
transfer unit and the transfer unit is transmitted, 
the original data stream can be reproduced using a 

15 cyclical structure indicated by this information on 
the receiving side. 

In the data communications system, since a data 
stream transferred in the first and second networks 
is composed of transfer units in which a plurality of 

20 types of different unit information are arranged in 
a prescribed format, the additional information 
generation means 111 can generate additional 
information, including type information about the kind 
of unit information included in each transfer unit. 

25 In this case, since the additional information 
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generation means 111 generates additional information, 
including information about the type of information 
composing atransferunit, this information is attached 
to a corresponding transfer unit and the transfer unit 
5 is transmitted, a transfer state can be managed for 
each different type of information on the receiving 
side . 

In the data communications system, since a data 
stream transferred in the first second networks is 

10 digital video data, the additional information 
generation means 111 can generate additional 
information, including information about the 
combination of a video information unit and an audio 
information unit included in each transfer unit. 

15 In this case, since the additional information 

generation means 111 generates additional information 
about the combination of audio information and video 
information, this information is attached to a 
corresponding transfer unit and the transfer unit is 

20 transmitted, the respective transfer states of the 
audio information and the video information can be 
managed on the receiving side. 

The data communications system comprises 
generation control means 114 for controlling the 

25 generation operation of a packet corresponding to each 



37 



transfer unit depending on a transmission mode, and 
the additional information generation means 111 can 
generate additional information, including 
information about a process content designated by each 
5 transfer unit using the generation control means 114. 

In this case, since both packet generation means 
112 and additional information generation means 111 
operate according to instructions from the generation 
control means 114, a different process can be applied 

10 for each transfer unit depending on a transmission mode, 
and information about the applied process content can 
also reported to the receiving side. 

In the data communications system, since a data 
stream transferred in the first and second networks 

15 is digital video data, the generation control means 
114 can judge whether audio information and video 
information, which are the constituent elements of each 
frame, should be transmitted and can instruct the packet 
generation means 112 to generate a packet, selectively 

20 including data to be transmitted. The additional 
information generation means 111 can generate 
additional information, including information about 
the type of data to be transmitted. 

In this case, since the generation control means 

25 114 for controlling the operation of the packet 
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generation means 112 depending on a transmission mode, 
for example ; a series of transfer units composing the 
relevant frame can be encapsulated by one of a process 
method for transmitting both pieces of video and audio 
5 information composing the frame for each frame, a 
process method for transmitting only one of audio 
information and video information and a process method 
for discarding the information of the relevant frame 
and can be transmitted to the third network. 

10 Simultaneously, information about the applied process 
method can be reported to the receiving side. 

In the data communications system, the 
generation control means 114 can designate only one 
of audio data included in each transfer unit or only 

15 a transfer unit, including audio data as a transmission 
target for the packet generation means 112 and can 
instruct the packet generation means 112 to generate 
only the packet of the transmission target when a 
transmission mode for instructing to transmit only 

20 audio data included in digital video data is inputted. 

In this case, since the generation control means 
114 controls the operation of the packet generation 
means 112 when a transmission mode for instructing only 
audio data is inputted, a series of packets, including 

25 a transfer unit that is generated from the audio 
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information extracted from the relevant frame or a 
series of packets obtained by selectively 
encapsulating a transfer unit, including audio 
information included in a transfer unit composing the 
5 relevant frame can be transmitted to the third network 
using the function of the transmitting means 113. 

The data communications system comprises a 
transmitting control means 115 for adjusting a 
transmission rate used when the transmitting means 113 

10 transmits a packet, including each transfer unit to 
the third network, to a prescribed transmission rate 
corresponding to a transmission mode when a 
transmission mode is inputted. 

In this case, since the transmitting control 

15 means 115 operates depending on a transmission mode, 
the transmitting means 113 can a packet corresponding 
to each transfer unit to the third network at a 
transmission rate suitable for the process method of 
each transfer unit indicated by the transmission mode. 

20 In the data communications system, the 

transmitting means 113 comprises a transmitting means 
116 for sequentially transmitting packets inputted as 
packets to be transmitted to the third network and a 
target input means 117 for inputting each packet 

25 generated by the packet generation means 112 to the 
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transmitting means 116 as a packet to be transmitted 
and also selectively repeatedly inputting a part of 
packets as packets to be transmitted. 

In this case, since the target input means 117 
repeatedly inputs a part of packets generated by the 
packet generation means 112 to the transmitting means 
116, a packet lost in the transmission process of the 
third network can be compensated for with the packet 
repeatedly transmitted. 

In the data communications system, the target 
input means 117 can input a packet to the transmitting 
means 116 as a packet to be transmitted as many times 
as required immediately after inputting a packet to 
be repeatedly transmitted. 

In this case, since the target input means 117 
inputs the copy of a packet to transmitting means 116 
following a packet to be repeatedly transmitted, there 
is no need of a device for storing the copy and thereby 
the hardware configuration for implementing the target 
input means 117 can be simplified. 

In the data communications system, since a data 
stream transferred in the first and second networks 
has a prescribed cyclical structure, the target input 
means 117 can store one cycle of data stream of the 
copy of a packet to be repeatedly transmitted and can 
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input the copy of the packet to be repeatedly 
transmitted to the transmitting means 116 after 
inputting packets corresponding to all transfer units 
composing one cycle of data stream. 
5 In this case, since the target input means 117 

can consecutively transmit packets to be repeatedly 
transmitted that are included in the relevant cycle 
after all packets corresponding toonecycleoftransfer 
units are transmitted to the third network, a packet 

10 to be repeatedly transmitted or the copy can be expected 
to reach the receiving side even if the lost of a packet 
bursts in a transmission route. 

In the data communications system, since a data 
stream transferred in the first and second networks 

15 has a prescribed cyclical structure, the target input 
means 117 can store in advance one cycle of data stream 
of both all packets generated by the packet generation 
means 112 and the copies of packets to be repeatedly 
transmitted and can input all the stored packets to 

20 the transmitting means 116 in a random order. 

In this case, the target input means 117 can 
transmit both all packets corresponding to one cycle 
of transfer units and the copies of packets to be 
repeatedly transmitted to the third network in a random 

25 order. 
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In this way, even if the lost of packets bursts 
in a transmission route, packets to be repeatedly 
transmitted or the copies can be expected to reach the 
receiving side. 
5 In the data communications system, the 

reproduction means 123 of the receiving side relay 
device 120 is configured as the array of a plurality 
of dimensions in which each element has a prescribed 
data length, and it comprises a receiving buffer 125 

10 for storing each transfer unit separated by the 
separation means 121 when a write instruction is 
inputted and a writing control means 126 for generating 
a write instruction indicating the relevant element 
of the array of a plurality of dimensions composing 

15 the receiving buffer 125, based on the analysis result 
of additional information corresponding to each 
transfer unit. 

In this case, since both the receiving buffer 
125 and writing control means 126 of the reproduction 

20 means 123 of the receiving side relay device 120 operate 
based on the analysis result on additional information 
corresponding to each transfer unit, information 
composing a transfer unit included in a received packet 
can be stored as the appropriate element of an array. 

25 Therefore, the order of each transfer unit in the 
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original data stream can be reproduced in the receiving 
buffer 125, regardless of the modification of the order 
in a transmission route. 

In the data communications system, since a data 
5 stream transferred in the first and second networks 
has a prescribed cyclical structure, the receiving 
buffer 125 can be an array structure of a plurality 
of dimensions based on the cyclical structure of a data 
stream. 

10 In this case, since the receiving buffer 125 is 

configured based on the cyclical structure of a data 
stream, the process load of the writing control means 

126 can be reduced. 

Fig. 8 shows the basic configuration of the data 
15 communications system in the second preferred 
embodiment of the present invention. 

In the data communications system, since the 
additional information generation means 111 of the 
transmitting side relay device 110 generates 
20 additional information, including a sequence number 
for indicating the transmission order of each transfer 
unit, the reproduction means 123 of the receiving side 
relay device 120 comprises a first evaluation means 

127 for evaluating the integrity of data stored in the 
25 receiving buffer 125, based on the continuity of 
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sequence numbers that are included in additional 
information separated from each packet that reaches 
the receiving side relay device 120 and a compensation 
means 128 for compensating for data stored in the 
5 receiving buffer 125, based on the evaluation result 
on the integrity of data stored in the receiving buffer 
125. 

In this case, the first evaluation means 127 
judges whether a series of packets transmitted to the 

10 third network by the transmitting side relay device 
reach the receiving side relay device with the order 
maintained, using the sequence numbers attached by the 
additional information generation means 111, and this 
judgment result can be provided for the compensation 

15 process of the compensation means 128. 

In the data communications system, a data stream 
transferred in the first and second networks is composed 
of transfer units obtained by arranging a plurality 
of different types of unit information in a prescribed 

20 format and the additional information generation means 
111 generates additional information, including type 
information about the type of unit information included 
each transfer unit. The reproduction means 123 of the 
receiving side relay device 120 comprises counter means 

25 129 for sorting and counting transfer units included 
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in each packet that reaches the receiving side relay 
device 120 for each piece of constituent unit 
information, second evaluation means 130 for 
evaluating the integrity of data stored in the receiving 
5 buffer 125, based on the counting result of the counter 
means 129 and compensation means 128 for compensating 
for data stored in the receiving buffer 125. 

In this case, both the counter means 12 9 and second 
evaluation means 130 can evaluated an arrival state 

10 for each different type of information composing a data 
stream, using type information attached by the 
additional information generation means 111, and the 
compensationmeans 128 canperforma finer compensation 
process based on this evaluation result. 

15 In the data communications system, since a data 

stream transferred in the first and second networks 
is digital video data, the counter means 129 can sort 
and count packets, including the audio information unit 
of digital video data. 

20 In this case, the counter means 129 can obtain 

information about the number of audio information units 
that reach the receiving side relay device 120. 

In the data communications system, since a data 
stream transferred in the first and second networks 

25 is digital video data, the counter means 129 can sort 
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and count packets , including the frame header 
information of digital video data. 

In this case, the counter means 129 can obtain 
information about the number of video information units 
5 that reach the receiving side relay device 120. 

In the data communications system, since a data 
stream transferred in the first and second networks 
is digital video data, the counter means 129 can sort 
and count packets, including the frame header 
10 information of digital video data. 

In this case, the counter means 129can obtain 
information about the number of frame header 
information units that reach the receiving side relay 
device 120. 

15 In the data communications system, the 

compensation means 129 comprises a compensation 
information storage means 131 for storing appropriate 
compensation information for each transfer unit and 
a composition means 132 for composing a data stream 

20 consisting of a series of transfer units by selecting 
either a transfer unit stored in the receiving buffer 
125 or corresponding compensation information, based 
on the evaluation result of the second evaluation means 
130. 

25 In this case, since the composition means 132 
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of the compensation means 128 operates based on the 
evaluation result of the second evaluation means 130, 
information that can replace the transfer unit can be 
compensated for f using the relevant compensation 
5 information stored in the compensation information 
storage means 131, for example, if a packet, including 
a transfer unit to be stored as the prescribed element 
of an array composing the receiving buffer 125, is lost. 

Fig. 9 shows the basic configuration of the data 

10 communications system in the third preferred 
embodiment of the present invention. 

In the data communications system, the receiving 
side relay device 120 comprises a delay amount storage 
means 133 for storing a prescribed delay amount and 

15 atarget determination means 134 for receiving position 
information about a position that the relevant transfer 
unit occupies in the original data stream, as an 
analysis result obtained about additional information 
separated from the latest arrival packet, determining 

20 a list of a series of transfer units to be reproduced 
by the reproduction meansl23 in units of the size of 
an array composing the receiving buffer 125, based on 
a result obtained by subtracting the delay amount from 
the position information and reporting the relevant 

25 array to the reproduction means 123. 
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In this case, since the target determination 
means 134 determines a series of transfer units to be 
reproduced using the delay amount stored in the delay 
amount storage means 133 based on additional 
5 information included the latest arrival packet, the 
relevant part of a data stream can be reproduced from 
each element of an array, including a transfer unit 
positioned before the latest arrival packet by the delay 
amount described above in the original data stream as 

10 an element. 

In this way, a transfer delay between a data stream 
transferred in the first network and a data stream 
reproduced by the reproduction means 123 can be 
maintained at the delay amount described above. 

15 In the data communications system, since a data 

stream transferred in the first and second networks 
is digital video data, the additional information 
generation means 111 of the transmitting side relay 
device 110 can generate additional information, 

20 including a frame number for indicating each video frame 
composing the digital video data. The receiving buffer 
125 can store a transfer unit, including information 
composing each piece of information in relation to a 
plurality of video frames as each element of an array. 

25 The delay amount storage means 133 can store a 
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prescribed number of frames as a delay amount. The 
target determination means 134 can receive the frame 
number from the analysis means 122 as the position 
information and can determine an array to be reproduced 
5 based on both this frame number and the prescribed 
number of frame. 

In this case, since the target determination 
means 134 operates based on the frame number received 
from the analysis means, the transfer delay between 

10 a data stream transferred in the first network and the 
data stream reproduced by the reproduction means 123 
can be maintained at the number of frames stored in 
the delay storage unit 133. 

In the data communications system, the 

15 additional information generation means 111 of the 
transmitting side relay can generate additional 
information, including a time stamp for indicating the 
transmission time of each transfer unit. The delay 
amount storage means 133 can store a prescribed delay 

20 time as a delay amount. The target determination means 
134 can receive the time stamp from the analysis means 
122 as position information and can determine an array 
to be reproduced, based on both the time indicated by 
this time stamp and the delay time. 

25 In this case, since the target determination 
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means 134 operates based on the time stamp received 
from the analysis means 122 , the transfer delay between 
a data stream transferred in the first network and the 
data stream reproduced by the reproduction means 123 
5 can be maintained at the delay time stored in the delay 
amount storage means 133. 

In the data communications system, the receiving 
side relay device comprises a modification means 135 
for modifying the delay amount stored in the delay 

10 amount storage means 133 when a modification 
instruction is inputted. 

In this case, since the modification means 135 
can dynamically the delay amount stored in the delay 
amount storage means 133, for example, the change in 

15 traffic in the third network, etc., can be flexibly 
coped with. 

Fig. 10 shows the basic configuration of the data 
communications system in the fourth preferred 
embodiment of the present invention. 

20 In the data communications system, each of the 

transmitting side relay device 110 and the receiving 
side relay device 120 comprises a control 
communications means 141 for transmitting/receiving 
a control packet in a prescribed format via the third 

25 network. 
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In this case, since each of the transmitting side 
relay device 110 and the receiving side relay device 
120 comprises a control communications means 141, 
control information for controlling the operation of 
5 the opposite device can be transmitted/received 
to/from each other. 

In the data communications system, the 
transmitting side relay device 110 comprises 
generation control means 114 for controlling the 

10 generating operation of a packet corresponding to each 
transfer unit when a transmission mode is inputted, 
transmitting control means 115 for adjusting a 
transmission rate used when the transmitting means 113 
transmits a packet, including each transfer unit to 

15 the third network, to a prescribed transmission rate 
corresponding to the transmission mode when the 
transmission rate is inputted and management 
information analysis means 142 for analyzing 
management information included the control packet 

20 received via the control communications means 141 of 
the self device and inputting an appropriate 
transmission mode to both the generation control means 
114 and transmitting control means 115, based on this 
analysis result. The receiving side relay device 120 

25 comprises management information collecting means 143 
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for collecting management information about the 
quality of a data stream that the self device receives 
via the third network, based on the analysis result 
obtained by the analysis means 122 or information about 
5 a reproduction process of the reproduction means 123 
and transmitting the information to the transmitting 
side relay device 110 as a control packet via the control 
communications means 141 of the self device. 

In this case, the receiving side relay device 

10 120 can notify the transmitting side relay device 110 
of management information about the quality of a data 
stream received via the third network by the management 
information collecting means 143 and control 
communications means 141 of the receiving side relay 

15 device 120. Then, the management analysis means 142 
of the transmitting side relay device 110 can operate 
and input an appropriate transmission mode to both the 
generation control means 114 and transmitting control 
means 115. 

20 In this way, the transmitting operation of the 

transmitting side relay device 110 can be controlled 
depending on the communications quality obtained based 
on information that actually reaches the receiving side 
Then, an appropriate process method can be applied to 

25 each transfer unit. Then, a packet can be transmitted 



53 



to the third network at an appropriate transmission 
rate . 

Fig. 11 shows the detailed preferred embodiment 
of the data communications system of the present 
5 invention. 

Each of two relay devices 210 and 220 comprises 
an 1EEE1394 adapter 411, and the two devices are 
connected to the first and second networks, 
respectively via this 1EEE1394 adapter 411. 
10 Each of the relay devices 210 and 220 further 

comprises an Internet adapter 413, and each of the relay 
devices is connected to the Internet via this Internet 
adapter 413. 

A DV/IP transmitting unit 211 shown in Fig. 11 
15 comprises an encapsulation unit 212 for 
IP-encapsulating an IEEE1394 packet received via the 
IEEE1394 adapter 411 by a method described later, and 
a packet redundancy transmitting unit 213 for receiving 
the IEEE1394 packet IP-encapsulated by the 
20 encapsulation unit and transmitting the packet to the 
Internet adapter 413 overlapping a part of packets by 
a method described later. 

Fig. 12 shows the detailed configuration of the 
DV/IP transmitting unit 211. 
25 The encapsulation unit 212 shown in Fig. 12 
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encapsulates an IEEE1394 packet in an Ethernet packet 
format, IP packet format or UDP packet format. As shown 
in Fig* 13, a header addition unit 214 generates a DV/IP 
payload by attaching additional information received 
5 from an additional information generating unit 215 to 
an IEEE1394 packet and further attaches an Internet 
header consisting of 20 bytes of an IP header, 8 bytes 
of an UDP header and 14 bytes of Ethernet header to 
the payload. 

10 The frame detection unit shown in Fig. 12 detects 

the head of a series of IEEE1394 packets for indicating 
one frame of both video data and audio data. A counter 
217 performs counting operation based on both the 
detection result of the frame detection unit 216 and 

15 the input of an IEEE1394 packet. 

The additional information generating unit 215 
has a function to generate additional information (see 
Fig. 13) , including a frame number for indicating both 
a video frame, to which an IEEE1394 packet belongs, 

20 and a block number for indicating a position occupied 
by the relevant IEEE1394 packet in the frame. 

In the packet redundancy transmitting unit 213 
shown in Fig. 12, a packet extraction unit 231 extracts 
a part of packets to be repeatedly transmitted that 

25 are generated by the encapsulation unit 212, according 
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to the instruction from a redundancy transmitting 
control unit 232 and stores the packets in a packet 
storage unit 231* 

The redundant packet insertion unit 233 shown 
5 in Fig. 12 reads packets to be repeatedly transmitted 
from the packet storage unit 231 in prescribed 
procedures according to the instruction from the 
redundant transmitting control unit 232 and inserts 
the packets in a series of packets inputted to the 

10 Internet adapter 413. 

In the relay device 220 shown in Fig. 11, a packet 
inputted to the DV/IP receiving unit 221 via the 
Internet adapter 413 is broken down into the additional 
information and an IEEE1394 packet by a decapsulation 

15 unit 222. 

Since the additional information separated from 
the DV/IP packet in this way is analyzed by an additional 
information analysis unit 223 and a writing control 
unit 224 operates based on this analysis result, each 

20 of the DIF blocks included each IEEE1394 packet is 
written in the relevant storage place of a receiving 
buffer 225. 

The integrity judgment unit 226 shown in Fig. 
11 receives additional information from the 
25 decapsulation unit 222, collects information about the 
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integrity of digital video data belonging to each frame 
based on this additional information, judges the 
integrity of designated frames based on the collected 
information and provides this judgment result for the 
5 reproduction process of a DV data reproduction unit 
227 . 

The delay adjustment unit 228 shown in Fig. 11 
operates according to the reproduction instruction 
from a DV transmitting control unit 229, determines 

10 a frame to be reproduced based on the decapsulation 
unit 2 22 and transmits this information for designating 
a frame to both the integrity judgment unit 226 and 
DV data reproduction unit 227* 

A DV transmitting control unit 229 obtains 

15 information about appropriate timing, for example, by 
transmitting/receiving a timing signal to/from the 
IEEE1394 adapter 411 and transmits a reproduce 
instruction to both the delay adjustment unit 228 and 
DV data reproduction unit 227, based on this signal. 

20 The digital video data reproduced by the DV data 

reproduction unit 227 shown in Fig. 27 are transmitted 
to the second network via the IEEE1394 adapter 411 as 
a packet stream in an IEEE1394 synchronous mode and 
are inputted to a digital video deck 402. 

25 Next, an operation in which the relay device 210 
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on the transmitting side transmits digital video data 
to be transmitted in an IEEE1394 synchronous mode in 
the first network, to the second network side via the 
Internet is described. 
5 Fig. 14 is a flowchart showing an operation of 

transmitting a DV/IP capsule. 

If an IEEE1394 packet f including information 
about the head of a frame, is inputted to the DV/IP 
transmitting unit 211 via the IEEE13 94 adapter 411 (step 

10 301), in step 302 judgment becomes yes based on the 
detection result of the frame detection unit 216 of 
the encapsulation unit 212. Then, a counter 217 
increments the counter value FC of a frame counter for 
indicating the number of frames and simultaneously sets 

15 the counter value of a packet counter for indicating 
the number of IEEE1394 packets belonging to a frame, 
to the initial value 1 (step 303). 

If in step 302 judgment is no, the flow proceeds 
to step 304 and only the counter value PC of the packet 

20 counter is incremented. 

The additional information generating unit 215 
receives the counter values PC and/or FC obtained in 
this way, calculates a data type for indicating the 
type of data included in the relevant IEEE1394 packet, 

25 based on this packet number, and as shown in Fig. 13, 
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it generates additional information by inserting the 
data type in the corresponding position (step 305) . 

In this case, since in an IEEE1394 synchronous 
mode, the combination of data included in the IEEE1394 
5 packet is uniquely determined by the packet number for 
indicating the order of each IEEE1394 packet, as shown 
in Fig. 1, the data type of each packet is determined, 
as shown in Fig. 13C. 

In Fig. 13C, symbols f, v and a indicate a DIF 

10 block, including a frame header , aDIFblock, including 
video data (hereinafter called a "video block") and 
a DIF block, including audio data (hereinafter called 
an "audio block") , respectively. "Empty" indicated in 
relation to data type DT2 indicates an empty packet 

15 stipulated in the IEEE1393 standard and "av mixed" 
indicated in relation to data type DT3 indicates a 
packet consisting of five video blocks and one audio 
block, regardless of the position of an audio block. 
Data types DT4 through DT9 correspond to the respective 

20 different combinations of audio blocks and video blocks, 
and data type DT10 indicates a control packet. 

When information generated in this way is 
inputted, the header addition unit 214 a DV/IP packet, 
by, first, attaching the additional information 

25 described above to an inputted IEEE1394 packet, then 
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by attaching an Internet header consisting of an IP 
header and an UDP header (step 306) and the obtained 
DV/IP packets are sequentially transmitted to the 
Internet via the Internet adapter 413 (step 307). 
5 At this moment, the redundancy transmitting 

control unit 232 judges whether the relevant DV/IP 
packet is to be repeatedly transmitted, for example, 
based on additional information included in each DV/IP 
packet (step 308). 

10 In this case, the redundancy transmitting 

control unit 232 judges whether the relevant DV/IP 
packet includes a frame header or audio data, for 
example, based on a block number included in the 
additional information. If one of them is included, 

15 the DV/IP packet is judged to be repeatedly transmitted . 

In this way, if it is to be repeatedly transmitted 
(Yes in step 308) , the packet storage unit 231 operates 
according to the instruction from this redundancy 
transmitting control unit 232, and in step 309, this 

20 DV/IP packet is stored and the flow proceeds to step 
310. 

If the Transmitted DV/IP packet is not to be 
repeatedly transmitted, in step 308 judgment becomes 
no, the flow proceeds to step 310 and in step 310 the 
25 redundancy transmitting control unit 232 judges 
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whether the transmitting operation of one frame of DC/ IP 
packets are completed. 

If in step 310 judgment becomes no, the flow 
returns to step 301 and a newly inputted IEEE1394 packet 
5 is processed. 

In this way, if both the encapsulation process 
and transmitting process of one frame of IEEE1394 
packets are completed, in step 310, the judgment of 
the redundancy transmitting unit 232 becomes yes, and 

10 the flow proceeds to step 311. At this moment, a 
redundant packet insertion unit 233 operates according 
to the instruction from this redundancy transmitting 
control unit 232 and the DV/IP packet to be repeatedly 
transmitted that is stored in the packet storage unit 

15 231 is transmitted to the Internet via the Internet 
adapter 413 (step 311). 

In this case, if the redundant packet insertion 
unit 233 repeatedly transmits the DV/IP packet stored 
in the packet storage unit 231, to the Internet adapter 

20 413 as many times as required, as shown in Fig. ISA 
after one frame of DV/IP packet strings are transmitted, 
the copies of packets to be repeatedly transmitted 
indicated by shading in Figs. ISA through ISC are 
repeatedly transmitted as many times as required. 

25 In this way, for example, by repeatedly 



61 



transmitting a DV/IP packet, including information 
indispensable for the reproduction of digital video 
data on the receiving side, the possibility that the 
digital video data may be prevented from being 
5 reproduced on the receiving side can be improved. 

As described above, a method for collectively 
transmitting redundant packets after completing the 
transmission of a series of DV/IP packets equivalent 
to one frame of digital video data is particularly 

10 effective when there is the sudden loss of packets such 
that several packets are consecutively lost. 

This is because there is a high possibility that 
packets consecutively lost may be compensated for by 
packets redundantly transmitted during a different 

15 time period. 

For the transmitting method of redundant packets, 
a method for transmitting the copies as many times as 
required following original packets to be repeatedly 
transmitted can also be adopted. 

20 For example, every time a DV/IP packet to be 

repeatedly transmitted is inputted, the redundant 
packet insertion unit 233 can repeatedly transmits the 
relevant DV/IP packet as many times as required 
according to the instruction from the redundancy 

25 transmitting control unit 232. 
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In this case, if there is the sudden loss of 
packets, there is the possibility that the redundant 
packets as well as the original packets to be repeatedly 
transmitted may be lost. However, since there is no 
5 need to store the copies of one frame of packets to 
be repeatedly transmitted, the increase of a hardware 
equipment amount can be avoided. 

Next, a method for receiving redundant DV/IP 
packets repeatedly transmitted as described above and 

10 reproducing the IEEE1394 packet stream, based on the 
additional information included in these DV/IP packets 
is described. 

Fig. 16 shows the detailed configuration of the 
DV/IP receiving unit. 

15 As shown in Fig. 16, additional information 

obtained by decapsulat ing a DV/IP packet by the 
decapsulation unit 222 is inputted to an additional 
information analysis unit 223, while each DIF block 
included in an IEEE1394 packet corresponding to the 

20 additional information described above (hereinafter 
called "DV data 7 ') is inputted to a receiving buffer 
225 via a writing control unit 224. 

This receiving buffer 225 has a capacity 
equivalent to k frames of digital video data. As shown 

25 in Fig. 17A, the storage area corresponding to each 
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frame of the receiving buffer 225 has a capacity 
equivalent to DV data included in each IEEE1394 packet 
and is composed of 250 storage places each corresponding 
to each block number. 
5 The writing control unit 224 receivesbotha frame 

number and a block number from the additional 
information analysis unit 223 and calculates a storage 
place indicated by the information. This information 
about the storage place is inputted to the receiving 

10 buffer 225 together with DV data. 

The integrity judgment unit 226 shown in Fig. 
16 comprises a counter control unit 241, a block counter 
unit 2 42 and an integrity evaluation unit 243. Theblock 
counter unit 242 counts according to the instruction 

15 from the counter control unit 241 and the counting 
result is provided for the process of the integrity 
evaluation unit 243. 

This counter control unit 241 receives a symbol 
for indicating a data type included as the additional 

20 information of a newly received packet and controls 
the counting operation of the block counter unit 242. 

As shown in Fig. 17B, this block counter unit 
242, for example, has respective memory areas for 
storing the total number of the received DV data RBCi 

25 (i=0-k) , the number of the header blocks HBCi (i=0— k) , 
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the number of audio blocks ABCi (i = 0-k) and the number 
of video blocks VBCi (i=0-k) of k frames and operates 
the numeric value of the relevant memory area according 
to instructions from the counter control unit 241. 
5 In Fig. 16, the DV data reproduction unit 227 

comprises a block reading unit 244 for reading DV data 
from the receiving buffer 225, a composition buffer 
245 for storing both DV data read by this block reading 
unit 244 and composition data, which are described later, 

10 a DV data editing unit 246 for reproducing the DV data 
from the data stored in this composition buffer 245 
and a composition control unit 247. 

A reproduce instruction from the DV transmitting 
control unit 229 shown in Fig. 11, the evaluation result 

15 of the evaluation value calculation unit 243 described 
above and a frame instruction, which is described later, 
are inputted to this composition control unit 247 . The 
composition control unit 247 controls the operations 
of the block reading unit 244, composition buffer 245 

20 and DV data editing unit 246 described above based on 
these instructions and information. 

The delay adjustment unit 228 shown in Fig. 16 
comprises an arrival information update unit 248 for 
updating arrival information about the latest arrival 

25 DV data, a delay amount storage unit 249 for storing 
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appropriate number of delay frames DF as a transfer 
delay amount and a frame determination unit 250 for 
selecting a frame to be reproduced from k frames each 
of which is composed of DV data stored in the receiving 
5 buffer 225, based on both the arrival information and 
the number of delay frames DF described above. 

Figs. 18A and 18B are a flowchart showing the 
receiving operation of a DV/IP packet and a flowchart 
showing the reproducing operation of digital video data, 

10 respectively. 

If a DV/IP packet is inputted via the Internet 
adapter 413 shown in Fig. 11, first, a decapsulation 
unit 222 separates additional information included in 
the inputted DV/IP packet from DV data (step 321) and 

15 transmits the information and data to the additional 
information analysis unit 223 and writing control unit 
22 4 , respectively. 

As described above, if additional information, 
including both cycle information and data type 

20 information, is attached by the DV/IP transmitting unit 
211, in step 322, first, the additional information 
analysis unit 223 extracts the cycle information from 
the additional information received from the 
decapsulation unit 222 and inputs the information to 

25 both the writing control unit 224 and arrival 
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information update unit 248. 

In this way, the writing control unit 224 writes 
the DV data in a storage place indicated by the cycle 
information of the receiving buffer 225 (step 323) and 
5 the arrival information update unit 248 of the delay 
adjustment unit 228 updates the latest cycle 
information about a DV/IP packet latest transmitted 
from the transmitting side (step 324). 

Since in this way, the writing control unit 224 

10 writes DV data in the receiving buffer 225 based on 
the cycle information, DV data included in each DV/IP 
packet can be stored and arrayed in the receiving buffer 
225 in the order of the original IEEE1394 packet stream, 
regardless of the arrival order. 

15 Therefore, i f a DV/ IP packet is lost , the relevant 

storage place of the receiving buffer 225 becomes empty . 
If the same DV/IP packet repeatedly arrives thanks to 
the redundancy transmitting process described above, 
etc. , the relevant storage place is simply overwritten 

20 by the same data. Therefore, the arrival state of each 
DV/IP packet can be easily managed. 

Then, the additional information analysis unit 
223 judges whether a received DV/IP packet includes 
new DV data, based on the cycle information extracted 

25 in step 322 (step 325) . 
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If the relevant cycle information is extracted 
for the first time, from the additional information 
analysis unit 223, the flow proceeds to step 326 after 
judgment in step 325 becomes yes. In step 326, the 
5 additional information analysis unit 223 extracts data 
type information from the additional information and 
transmits the information to the counter control unit 
241 of the integrity judgment unit 226 together with 
the cycle information. 

10 In this case, the counter control unit 241 

indicates a counter value to be updated, based on both 
the received cycle and data type information. Then, 
the block counter unit 242 updates the relevant counter 
value by appropriately increasing the relevant counter 

15 value (step 327) . 

For example, on receipt of both cycle information 
indicating that DV data is included in frame 1 and data 
type information indicating that the DV data consist 
of one audio block and five video blocks, the counter 

20 control unit 241 instructs the update of the total 
number of blocks RBC1, the number of audio blocks ABC1 
and the number of video blocks VBC1 corresponding to 
frame 1 (see Fig. 17B) . 

Then, the block counter unit 242 updates the 

25 respective counter values of both the total number of 
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blocks RBC1 and the number of audio blocks ABC1 by 
increasing by one and updates the counter value of the 
number of video blocks VBC1 by increasing by five . Then, 
the block counter unit 242 terminates the receiving 
5 operation of this DV/IP packet. 

If DV data corresponding to the same cycle 
information are already received, the flow skips steps 
326 and 327 after judgment in step 325 becomes no, and 
terminates the receiving process of the relevant DV/IP 
10 packet. 

In this way, since the writing control unit 224 
and receiving buffer 225 as well as the counter control 
unit 241 and block counter unit 242 operate based on 
the analysis result of the additional information 

15 analysis unit 223, the DV data can be arrayed in the 
order of the original IEEE1394 packet stream, and 
information about the arrival stateof DV data composing 
each frame can also be collected. 

In particular, by totaling DIF blocks stored in 

20 the receiving buffer 225 for each type in addition to 
the total number of receiving blocks in the block 
counter unit 242, for example, detailed information 
about the respective numbers of arrival video blocks 
and audio blocks of each frame can be obtained, and 

25 the reproduction process of the digital video data of 
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each frame can be supported. 

Next, a method for reproducing digital video 
data to be transmitted to the second network via the 
IEEE1394 adapter 411 based on both the detailed 
5 information about an arrival state collected in this 
way and DV data arrayed in the receiving buffer 225 
is described. 

First , a frame determination unit 250ofthe delay 
adjustment unit 228 determines a frame to be reproduced 

10 based on both the arrival information and delay amount 
received from an arrival information update unit 248 
according to the reproduce instruction from a DV 
transmitting control unit 229 (step 331). 

In this case, the frame determination unit 250, 

15 for example, subtracts the number of frames stored in 
the delay amount storage unit 249 as a delay amount 
from cycle information received as arrival information, 
designates a frame, to which DV data indicated by 
obtained cycle information belong, as a frame to be 

2 0 reproduced and notifies both an integrity judgment unit 
226 and DV data reproduction unit 227 of the frame. 

In this case, since the arrival information 
indirectly indicates DV data transmitted last from the 
transmitting side, the delay between an IEEE1394 packet 

25 stream in the first network on the transmitting side 
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and an IEEE1394 packet stream reproduced by a DV data 
reproduction unit 227 as described later can be kept 
constant by determining a frame to be reproduced as 
described above. 
5 Specif ically, the stop and re-start of 

transmission to the second network and the thinning -out 
of a frame can be automatically conducted both at the 
transfer rate of a DV/IP packet in the Internet and 
at the transmission speed of a DV/IP packet on the 

10 transmitting side in the relay device 220 on the 
receiving side, by determining a frame to be reproduced 
in this way. 

On receipt of the notification of a frame to be 
reproduced, the integrity evaluation unit 243 of the 

15 integrity judgment unit 226 refers to each counting 
result on the relevant frame stored in the block counter 
unit 242 described above, and evaluates the arrival 
integrity of the relevant frame based on these counting 
results (step 332). 

20 In this case, the integrity evaluation unit 243, 

for example, compares each of the total number of 
receiving blocks RBCi stored in the block counter unit 
242 in relation to a designated frame, the number of 
header blocks HBCi, the number of audio blocks ABCi 

25 and the number of video blocks VBCi with the respective 
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value equivalent to those of one complete frame and 
notifies the composition control unit 247 of the DV 
data reproduction unit 227 of these comparison results 
as evaluation results. 
5 For example, if it is evaluated that the total 

number of receiving blocks RBCi corresponding to a frame 
to be reproduced is equal to the number of blocks RBC 
equivalent to that of one complete frame, the 
composition control unit 247 judges that complete DV 

10 data composing this frame arrive (Yes in step 333) , 
and transmits the DV data of the relevant frame stored 
in the receiving buffer 225 to the IEEE1394 adapter 
via the block reading unit 244, composition buffer 245 
and DV data editing unit 246 without any process (step 

15 334) . 

Inthiscase, as shown in Fig . 19A, the composition 
buffer 245 comprises a first buffer with a capacity 
of one frame and a second buffer with a capacity of 
one frame. Each of the first and second buffers has 

20 a memory capacity equivalent to 250 IEEE1394 packets. 

In the following description, a case where 
composition is conducted by storing composition data, 
which are described later, in the first buffer, and 
storing DV data read from the receiving buffer 225 by 

25 the block reading unit 244 in the second buffer in 
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ascending order of block numbers, is described. 

As described above, if a complete set of DV data 
composing a frame to be reproduced arrive, the 
composition control unit 247 reads the DV data of the 
5 relevant frame from the receiving buffer 225 via the 
block reading unit 224, inputs the data to the second 
buffer, and instructs the DV data editing unit 246 to 
transmit the DV data stored in the second buffer to 
the IEEE1394 adapter as transmitting data without any 

10 process. 

In this case, the composition buffer 245 
designates the latest transmitting data as composition 
data by transferring the DV data stored in the second 
buffer to the first buffer according to the instruction 

15 from the composition control unit 247 (step 335) and 
terminates the reproduction process. 

If, for example, a DV/IP packet, including DV 
data shown in block number 2, islostinthe transmission 
process of frame (n) to be reproduced, the integrity 

20 evaluation unit 243 described above judges that the 
total number of receiving blocks RBCn and number of 
video blocks VBCn that correspond to those of the 
relevant frame are smaller than the reference values 
RBC and VBC, respectively. 

25 In this case, the judgment in step 333 becomes 
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no, the flow proceeds to step 336 and the composition 
control unit 247 composes transmitting data by 
compensating for the lost receiving data with the 
composition data. 
5 For the principle of composing transmitting data 

when DV data are lost,, a principle of replacing the 
lost DV data with composition data in units of IEEE1394 
packets (hereinafter called the "first principle", a 
principle of replacing only the relevant type of lost 

10 DV data with composition data in relation to the type 
of the lost DV data (hereinafter called the "second 
principle", etc., are used in addition to frame policies 
of designating composition data as transmitting data 
by discarding the full receiving data of the relevant 

15 frame, stopping the transmission of the relevant frame, 
etc . 

If the first or second principle is adopted, in 
step 336, the composition control unit 247 first reads 
DV data of each block composing frame (n) to be 
20 reproduced from the receiving buffer 225 and stores 
the data in the second buffer by controlling the both 
the block reading unit 244 and composition buffer 245. 

If the first principle is adopted, the DV data 
editing unit 24 6 composes transmitting data by 
25 replacing only DV data in block number 2 indicated by 
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symbol "LOST" in Fig. 19A with corresponding DV data 
in the first buffer according to the instruction from 
the composition control unit 247. 

In this case, if, as shown in Fig. 19A, the DV 
5 data of each block composing frame (n-1) are stored 
in the first buffer, the lost DV data are replaced with 
the DV data of the corresponding block of frame (n-1) 
(shown by symbol DV (n _i /2 ) in transmission data 
corresponding to frame(n) by all the units of the DV 

10 data reproduction unit 227. 

If, for example, as shown in Fig. 19B, DV data 
consisting of only video blocks, the second principle 
can be adopted. 

In this case, the DVdata editing unit 24 6 operates 

15 according to the instruction from the composition 
control unit 247 and transmitting data are composed 
by replacing only audio block a n _i indicated by netting 
in composition data stored in the first buffer shown 
in Fig. 19B, with a corresponding audio block that is 

20 included in new receiving data stored in the second 
buffer . 

In this way, since the DV data editing unit 246 
operates according to the instruction from the 
composition control unit 247 and information lost in 
25 the transmission process of a DV/IP packet can be 



75 



compensated for with appropriate information in the 
reproduction process of DV data composing each frame 
by utilizing the structure of digital video data, an 
IEEE13 94 packet stream very close to the 1EEE1 394 packet 
5 stream in the first network on the transmitting side 
can be edited. 

The transmitting data composed by the DV data 
editing unit 246 in this way are transmitted to the 
second network via the IEEE1394 adapter 411 and the 

10 reproduction process of this frame is terminated after 
in step 325 the transmitting data are stored as 
composition data. 

In this way, the delay adjustment unit 228, 
integrity judgment unit 226 and DV data reproduction 

15 unit 227 operate according to a reproduce instruction, 
transfer delay against the transmitting side can be 
kept constant, and thereby a high-level IEEE1394 
packet stream can be reproduced and transmitted to the 
second network via the IEEE1394 adapter 411 despite 

20 the occurrence of packet loss in the transmission 
process of a DV/IP packet. 

The delay adjustment unit 228 can also designate 
the oldest frame stored in the receiving buffer as a 
frame to be reproduced. 

25 For example, the delay adjustment unit 228 



76 



comprises FIFO having as many frames of memory area 
as the receiving buffer 225 can store, continues to 
store the frame number of a new frame in this FIFO every 
time the DV data of the new frame is stored in the 
5 receiving buffer 225 and notifies both the integrity 
judgment unit 226 and DV data reproduction unit 227 
of the frame number read from the head of the FIFO 
according to a reproduce instruction. 

A high evaluation score can be expected from a 

10 user on the second network side by performing the 
compensation process of lost data in the DV data 
reproduction unit 227 according to the second principle 
as described above and transmitting transmission data 
obtained by using and composing only audio data included 

15 in new receiving data, as shown in Fig. 19B, to the 
second network. 

This is because, as described above, the audio 
continuity can be guaranteed by DV data , only the audio 
blocks of which is updated, and pictures and voice 

20 naturally caught by the subjectivity of a user can be 
provided . 

Furthermore, if the DV/IP transmitting 211 of 
the relay device 210 on the transmitting side 
selectively repeatedly transmits a DV/IP packet, 
25 including an audio block, a method for compensating 
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for lost data according to the second principle 
described above is very useful since the arrival 
probability of a DV/IP packet, including an audio block 
is very high. 

5 If a DV/IP packet, including an audio block, is 

lost, video blocks included in composition data are 
replaced with video blocks included a newly received 
frame according to the second principle and the audio 
block included in the relevant frame can be compensated 
10 for with the audio block included in the composition 
data . 

If DV data are edited in units of frames according 
to the first principle, for example, both fixed 
composition data consisting of video data representing 

15 one prescribed frame of pictures and audio data and 
one frame of audio data representing silence are 
prepared in advance, and the DV data of the frame can 
also be replaced with the fixed composition data if 
there is the loss of DV data. 

20 Since the composition control unit 247 selects 

an appropriate principle and controlling the 
composition process of the DV data editing unit 246, 
according to the type and amount of information lost 
in a transmission route, lost data can also be 

25 compensated for while dynamically switching a 
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plurality of principles. 

Next, a method for adjusting the transmitting 
operation of a DV/IP packet by the relay devices on 
the transmitting and receiving sides 

5 transmitting/receiving control information to/from 
each other is described. 

Fig. 20 shows the configuration of the data 
communications system. 

In Fig. 20, each of the relay device on the 
10 transmitting side 110 and the relay device on the 
receiving side 120 comprises a control packet 
processing unit 251 for transmitting/receiving 
control information by transmitting/receiving a 
control packet, which is described later, via both the 
15 DV/IP transmitting unit 250 and DV/IP receiving unit 
260 and an IP transmitting control unit 252 for 
adjusting the transmission rate of the Internet adapter 
413 and also editing and transferring transmitting data 
received from the IEEE1394 adapter to the DV/IP 
20 transmitting unit 250, according to both an 
instruction from this control packet processing unit 
251 and a mode instruction, which is described later, 
in addition to all the units shown in Fig. 11. 

The control packet processing unit shown in Fig. 
25 20 comprises a control information analysis unit 253, 



79 



an instruction analysis unit 254, an arrival 
information collection unit 255 and a control packet 
generation unit 256. The instruction analysis unit 254 
controls both the arrival information collection unit 
5 255 and control packet generation unit 256, based on 
the analysis result of the control information analysis 
unit 253 and a transmit instruction, which is described 
later . 

This control information analysis 253 receives 

10 control information, which is described later, from 
a DV/IP packet receiving unit 221 and notifies both 
the IP transmitting control unit 252 and designation 
analysis unit 254 of the analysis result obtained by 
analyzing this control information. 

15 The arrival information collection unit 255 

collects arrival information about a packet that 
reaches the self-device based on information stored 
in all the units in of the DV/IP receiving 260 according 
to the instructions from the designation analysis unit 

20 254 and transmits the obtained arrival information to 
the control packet generation unit 256. This control 
packet generation unit 256 generates a control packet 
as described later, according to an instruction from 
the designation analysis unit 254 and transmits the 

25 packet to the DV/IP transmitting unit 250. 
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Fig. 21 shows both detailed configuration of the 
IP transmitting control unit and an example of another 
configuration of the DV/IP transmitting unit. 

The IP transmitting control unit 252 shown in 
Fig. 21 comprises a transmitting information editing 
unit 258, a mode information storage unit 257 and a 
mode control unit 259. This mode information storage 
unit 257 receives a mode instruction and stores mode 
information included in this mode instruction. The 
transmitting information editing unit 258 selects 
information to be transmitted to the receiving side 
from information composing an IEEE13294 packet stream 
received from the IEEE1394 adapter 411 according to 
both an instruction from the mode control unit 259 and 
edits transmitting information. 

In this case, mode information is composed of 
symbols for indicating the respective transmission 
modes corresponding to a prescribed number of 
consecutive frames . 

The mode control unit 259 controls the editing 
operation of the transmitting information editing unit 
25 8 as described later, based on mode information stored 
in the mode information storage unit 257, instructs 
a transmission rate to the Internet adapter 413 and 
modifies the mode information stored in the mode 
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information storage unit 257, based on the analysis 
result of the control information analysis unit 253. 

The control packet generated by the control 
packet generation unit 256 is inputted to a header 
5 addition unit 214 of an encapsulation unit 271 together 
with the editing result of the transmitting information 
editing unit 258 described above. 

This encapsulation unit 271 comprises a cycle 
information generation unit 2 72 that correspond to both 

10 the frame detection unit 216 and counter 217 shown in 
Fig. 12 and a packet judgment unit 273 for judging 
whether an input packet is an IEEE1394 packet or a 
control packet. 

Both the judgment result of this packet judgment 

15 unit273 and the cycle information obtained by the cycle 
information generation unit 272 are inputted to an 
additional information generating unit 274. The mode 
control unit 259 described above notifies this 
additional information generating unit 274 of the 

20 transmission mode of a frame to be transmitted. 

The additional information generated by this 
additional information generating unit 274 is inputted 
to the header addition unit 214 and is attached to a 
corresponding IEEE1394 packet or a control packet by 

25 this header addition unit 214 as a header. Then, the 
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DV/IP packet shown in Fig. 12 is generated and 
transmitted to a packet redundancy transmitting unit 
275. 

As shown in Fig. 21, this packet redundancy 
transmitting unit 275 comprises a transmitting buffer 

276 for sequentially storing DV/IP packets received 
from the encapsulation unit 271, a packet copying unit 

277 for copying DV/IP packets to be repeatedly 
transmitted and storing the packets in the transmitting 
buffer 276 and a packet output unit 278 for reading 
DV/IP packets stored in the transmitting buffer 276 
in a random order and transmitting the packets to the 
Internet adapter 413. 

Next, the DV/IP packet transmitting operation 
of the relay device 110 on the transmitting side shown 
in Fig. 20 is described. 

Fig. 22 is a flowchart showing the transmitting 
operation of DV/IP packets. 

Prior to the transmitting process of an IEEE1394 
packet stream composing each frame, the mode control 
unit 259 shown in Fig. 21 first refers to mode 
information stored in the mode information storage unit 
257, calculates an appropriate transmission rate and 
notifies the Internet adapter 413 of the rate (step 
341) . 
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In this case, for the transmission mode, for 
example, a "cut" mode for cutting the relevant frame, 
a "voice only'' mode for transmitting only the audio 
blocks of the relevant frame, a "picture only" for 
5 transmitting only the video blocks oft he relevant frame, 
a "normal" mode for transmitting the full information 
composing the relevant frame, etc., are used. 

Therefore, mode information is generated by 
arraying a prescribed number of symbols of two bits 
10 for indicating the four transmission modes described 
above and is stored in advance in the mode information 
storage unit 257. 

For example, 32 bits of memory area are prepared 
as the mode information storage unit 257 and 16 frames 
15 of symbol strings are stored in this mode information 
storage unit 257 as mode information. 

In this case, since the mode control unit 259 
sequentially refers to these codes and performs a 
transmitting process in accordance with a transmission 
20 mode indicated by each code as described later, digital 
video data composing each frame are transmitted with 
consecutive 16 frames as one set in a transmission mode 
indicated by corresponding codes. 

Therefore, In step 341, the mode control unit 
25 259 calculates an appropriate transmission rate based 
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on both an information amount to be transmitted of a 
prescribed number of frames corresponding to these code 
strings and a transmission time in the case where 
IEEE1394 packets corresponding to these frames are 
5 transmitted in an IEEE1394 synchronous mode, according 
to mode information. 

There is no limit in the size of a memory area 
to be secured as the mode information storage unit 257 . 
Therefore, code strings corresponding to more number 

10 of frames can also be stored or only several frames 
of code strings can also be stored as mode information. 

Then, the mode control unit 259 refers to the 
mode information storage unit 257 described above and 
notifies both the transmitting information editing 

15 unit 258 and additional information generating unit 
274 of codes corresponding to frames to be processed 
(step 342) . 

Then, the transmitting information editing unit 
258 performs an editing process designated by a 
20 transmission mode when each IEEE1394 packet is inputted 
(steps 343 and 344) . 

For example, if the transmission mode of a frame 
to be processed is a "cut" mode, the transmitting 
information editing unit 258 discards all the TEEE1394 
25 packets belonging to the relevant frame. If a "normal" 
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mode is designated, all the IEEE1394 packets are 
transmitted to the encapsulation unit 271. 

If the transmission mode of a frame to be processed 
is a "picture only" mode, the transmitting information 
5 editing unit 258 extracts both header blocks and video 
blocks included a series of IEEE1394 packets belonging 
to the relevant frame and transmits packet strings, 
each of which consists of six of the obtained video 
blocks, to the encapsulation unit 271 following an 

10 IEEE1394 packets consisting of frame blocks. 

If a "voice only" is designated, the transmitting 
information editing unit 258 extracts both IEEE1394 
packets, each including a frame header block and 
IEEE1394 packets, each including an audio block from 

15 a series of IEEE1394 packets belonging to the relevant 
frame and transmits a packet string consisting of these 
IEEE1394 packets to the encapsulation unit 271 as an 
editing result. 

When the editing result obtained as described 

20 above is inputted, the encapsulation unit 271 performs 
the IP encapsulation process of each packet composing 
this editing result (step 345). 

In this case, the additional information 
generating unit 274 generates additional information, 

25 including type information, cycle information 
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consisting of a frame number and a block number, and 
a time stamp for indicating the current time together 
with codes for indicating a transmission mode, which 
is shown by symbol "MODE" in Fig. 13, based on both 
a code received from the mode control unit 259 and cycle 
information obtained by both the judgment result of 
the packet judgment unit 273 and the cycle information 
generation unit 272, as shown in Fig. 13B. 

In this case, as described above, a packet string 
edited based on a transmission mode has a cyclical 
structure corresponding to each transmission mode. 

Therefore, if the packet judgment unit 273 
reports that an inputted packet is an IEEE1394 packet, 
the additional information generating unit 274 can 
obtain type information based on both codes for 
indicating a transmitting code and cycle information. 

If it is reported that an inputted packet is a 
control packet, the additional information generating 
unit 274 generates additional information, including 
type information about the fact, which is shown by 
symbol "DT10" in Fig. 13C. 

When additional information obtained in this way 
is inputted, the header addition unit 214 generates 
a DV/IP packet as in step 306 and the obtained DV/IP 
packet is stored in the transmitting buffer 276 of the 
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packet redundancy transmitting unit 275. 

In this case, the packet copying unit 277 judges 
whether an inputted DV/IP packet is to be repeatedly 
transmitted (step 346). If the judgment is yes, the 
5 copy of the relevant DV/IP packet is overlapped and 
stored in the transmitting buffer 276 (step 347). 

If the judgment in step 346 is no, the flow 
proceeds to step 348 without any process and the packet 
output unit 278 judges whether all the DV/IP packets 
10 belonging to a frame to be processed are stored in the 
transmitting buffer 276. 

If the judgment in step 348 is no, the flow returns 
to step 343, and both the editing process of a subsequent 
packet and the encapsulation process of the editing 
15 result are performed. 

If in this way, both the editing process and 
encapsulation process of one frame of IEEE1394 packet 
strings are completed, the judgment in step 348 is yes, 
and the packet output unit 278 reads all the DV/IP 
20 packets stored in the transmitting buffer 276 in an 
random order and transmits the packets to the Internet 
adapter 413 (step 349) . 

In this case, the packet output unit 278 arrays 
all the DV/IP packets stored in the transmitting buffer 
25 276, including the copies of packets to be repeatedly 
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transmitted, regardless of the order in the original 
IEEE1394 packet stream, as shown in Fig. 15C and 
transmits the packets to the Internet adapter 413. 

Therefore, even if packet loss bursts in the 
5 transmission route of a DV/IP packet, packets to be 
repeatedly transmitted or the copies can be surely 
transmitted to the receiving side. 

In this case, if the packet output unit 278 inserts 
a sequence number for indicating a transmitting order 

10 as a part of additional information included in each 
transmitted DV/IP packet (see Fig. 13B) , an arrival 
integrity check can be made based on the sequence number 
as described later on the receiving side. 

If in this way, an IEEE1394 packet string 

15 corresponding to a new frame inputted from the first 
network side after the transmission of the generated 
DV/IP packets of a frame to be processed, the judgment 
in step 350 becomes no, the flow returns to step 342, 
the transmitting process of this IEEE1394 packet string 

20 is performed in a transmission mode corresponding to 
the relevant frame. 

In this way, both an execution ratio of cut and 
a ratio of frames transmitting only voice can be highly 
freely designated, for example, by a mode instruction. 

25 DV/IP packet strings can be transmitted at a 
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practical transmission rate suitable for a transfer 
rate in the Internet by controlling the respective 
number of frames to be cut and frames with voice only. 

For example, if a code string obtained by 
5 appropriately combining codes for indicating a 
"normal" mode and codes for indicating a "voice only" 
mode is designated, an information amount to be 
transmitted to the Internet as a DV/IP packet string 
can be greatly reduced, and thereby the occurrence 

10 probability of packet loss, etc., can be reduced. 

If in step 344, a "voice only" mode is designated 
as a transmission mode, the transmitting information 
editing unit 258 shown in Fig. 21 can also extract audio 
blocks included in a series of IEEE1394 packets 

15 belonging to the relevant frame and can also transmit 
a packet string consisting of six of the audio blocks, 
to the encapsulation unit 271. 

In this case, since the transmitting information 
editing unit 258 must generate a packet consisting of 

20 audio blocks from a plurality of IEEE1394 packets, a 
process amount required for the editing process 
increases, while an information amount to be 
transmitted as DV/IP packets can be greatly reduced. 
In this case, type information DT11 for 

2 5 indicating a packet consisting of only voice is prepared 
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in the encapsulation unit 271, and the additional 
information generating unit 274 generates additional 
information^ including this type information DT11 and 
transfers the information to the header addition unit 
5 214 . 

Next, the receiving operation of the relay device 
120 on the receiving side is described. 

Fig. 23 shows the relationship between a DV/IP 
receiving unit 2 60 and a control packet processing unit . 

10 The DV/IP receiving unit 260 shown in Fig* 23 

comprises an integrity judgment unit 261 and a delay 
adjustment unit 262, instead of the integrity judgment 
226 and delay adjustment unit 228, respectively, and 
further comprises the packet sorting unit 263 in 

15 addition to the units shown in Fig. 11. 

This packet sorting unit 263 receives a payload 
included in a DV/IP packet from the decapsulation unit 
222 and transfers DV data and control information 
included in a control packet, to a writing control unit 

20 224 and the control packet processing unit 251, 
respectively, based on the analysis result of the 
additional information analysis unit 223. 

Fig . 24 shows the detailed configurations of both 
the integrity judgment unit 261 and delay adjustment 

25 unit 262. 
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The integrity judgment unit 261 shown in Fig, 
24 comprises a sequence counter 265 for checking the 
continuity of sequence numbers received from the 
additional information analysis unit 223 in addition 
5 to the units of the integrity judgment unit 226 shown 
in Fig. 16. 

In this integrity judgment unit 261, the check 
result of the sequence counter 265 is inputted to an 
integrity evaluation unit 243 together with the 
10 counting result of a block counter 242. 

The delay adjustment unit 262 shown in Fig. 24 
comprises a time stamp update unit 266 with a function 
described later, instead of the arrival information 
update unit 248 shown in Fig. 16, and also comprises 
15 a delay amount update unit 2 67 for modifying the content 
of a delay amount storage unit 249 according to the 
instructions from a designation analysis unit 254. 

In this delay adjustment unit 262, the process 
result of the time stamp update unit 266 is inputted 
20 to a frame determination unit 250 together with a delay 
amount stored in the delay amount storage unit 249. 

Information about a frame to be reproduced 
obtained by this frame determination unit 250 is 
inputted to a management information collecting unit 
25 225 together with an integrity evaluation result. 
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Since the packet sorting unit 263 shown in Fig. 
23 operates based on the analysis result of the 
additional information analysis unit 223, the 
receiving function of the control communications means 
5 141 can be implemented using the functions of both the 
Internet adapter 413 and DV/IP receiving unit 221. 

Next, both a process for receiving DV data using 
the receiving buffer 225 and a process for reproducing 
an IEEE1394 packet stream from received DV data 
10 depending on the transmission mode described above are 
described . 

Figs. 25A and 25B are flowcharts showing the 
receiving operation and reproducing operation, 
respectively, of a DV/IP packet. 

15 If a DV/IP packet is inputted, as shown in Fig. 

18A, the decapsulation unit 222 separates additional 
information and a payload part from the packet and 
transmits the information and payload to the writing 
control unit 224 and additional information analysis 

20 unit 223, respectively (step 321) . 

Then, the additional information analysis unit 
223 notifies the sequence counter 265 of a sequence 
number included in the additional information. Then 
this sequence counter 2 65 checks the continuity of DV/IP 

25 packet strings transmitted via the Internet based on 
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both the inputted sequence number and a sequence number 
inputted immediately before (step 351). 

This sequence counter 265, for example, stores 
in advance a sequence number inputted immediately 
5 before as an immediately previous number, judges 
whether DV/IP packets consecutively arrive in a 
transmitted order, based on the relationship between 
this immediately previous number and a newly inputted 
sequence number, and notifies the integrity evaluation 

10 unit 243 of this judgment result. 

Then, the additional information analysis unit 
223 judges whether a received DV/IP packet is a control 
packet, based on type information (step 352). If the 
j udgment is yes, processes after step 352 can be skipped 

15 and the receiving operation is terminated. 

If the judgment in step 352 is no, the additional 
information analysis unit 223 extracts both cycle 
information and a transmission mode from additional 
information, and notifies the writing control unit 224 

20 of both the information and mode (step 353) . Then, the 
writing control unit 224 operates to write DV data in 
the receiving buffer 225 (step 354). 

For example, if a "voice only" mode is designated 
as a transmission mode, the writing control unit 224 

25 write inputted DV data, which are shown by attaching 



94 



symbols a and v in Fig. 26A, in a storage place 
corresponding to the DV data, including an audio block, 
as shown in Figs. 26A through 26C. 

Similarly, if a "'picture only" mode is 
5 designated as a transmission mode, the writing control 
unit 224 writes video blocks included in inputted DV 
data in a storage place corresponding to video blocks 
composing DV data belonging to the relevant frame, as 
shown by attaching symbol v in Fig. 26A. 

10 Then, the additional information analysis unit 

223 extracts a time stamp included in additional 
information and notifies the time stamp update unit 
266 of the delay adjustment unit 262 of the time stamp. 
Then, this time stamp update unit 266 updates a time 

15 stamp for indicating arrival information (step 355) . 

Then, both the additional information analysis 
unit 223 and integrity judgment unit 261 perform the 
same operations as those in steps 325 through 327 to 
update the counter value of the block counter unit 242 

20 when non-redundant DV data are inputted. 

In this case, the counter control unit 241 
receives codes for indicating a transmission mode 
together with type information from the additional 
information analysis unit 223 and stores the codes in 

25 a memory area corresponding to the relevant frame, of 
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the block counter unit 242. 

Next, a method for reproducing one frame of 
IEEE1394 packet strings based on a variety of 
information generated from both DV data and additional 
5 information that are stored in the receiving buffer 
225, as described above, is described. 

Fig. 25B is a flowchart showing the reproducing 
operation of DV data. 

The frame determination unit 250 of the delay 
10 adjustment unit 262 determines a frame to be reproduced 
when a reproduce instruction is inputted, as in the 
case of the flowchart shown in Fig. 18B (step 331). 

In this case, the frame determination unit 250 
calculates a time that is traced back by a delay time 
15 stored in the delay amount storage unit 248, from a 
time stamp received from the time stamp update unit 
266 as arrival information, designates a frame, 
including DV data with a time stamp corresponding to 
this time as a frame to be reproduced and notifies both 
20 the integrity j udgment unit 2 62 and DV data reproduction 
unit 227 of the frame. 

Then, the integrity evaluation unit 243 of the 
integrity judgment unit 261 first refers to a 
transmission mode stored in relation to a frame 
25 designated as a frame to be reproduced. If a 
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transmission mode is a "cut" mode, the judgment in step 
361 becomes yes and the reproduction process is 
terminated . 

If the judgment in step 361 is no, the integrity 
5 evaluation unit 243 evaluates the arrival integrity 
of a frame to be reproduced based on both a transmission 
mode corresponding to the relevant frame and the counter 
value of a block counter unit 242 (step 332). 

In this case, an integrity evaluation unit 243 

10 prepares in advance the appropriate respective 
reference values of a "normal" mode, a "voice only" 
mode and a "picture only" mode, evaluates the arrival 
integrity of a frame to be reproduced based on a result 
obtained by comparing each counter value stored in the 

15 block counter unit242with the relevant reference value, 
and notifies the composition control unit 247 of a DV 
data reproduction unit 227 (see Fig. 16) of the result. 

If it is evaluated that a complete set of DV data 
to arrive are delivered and it is reported that a 

20 transmission mode is a "normal" mode (Yes in steps 333 
and 362) , ablock reading unit 2 4 4 , a composition buffer 
245 and a DV data editing unit 246 execute steps 334 
and 335 according to the instructions from the 
composition control unit 247. 

25 Inthisway, DV da ta stored in the receiving buff er 
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225 are transferred to the IEEE1394 adapter 411 via 
both the composition buffer 245 and DV data editing 
unit 246, and are transmitted to the second network 
as an IEEE1394 packet string. 
5 If it is evaluated that there is loss in DV data 

(No in steps 333) and a transmission mode is a "voice 
only" mode or a "picture only" mode (No in step 362) , 
both the composition buffer 245 and DV data editing 
unit 246 execute steps 336 and 335 according to 

10 instructions from the composition control unit 247. 

For example, if a transmission mode is a "voice 
only" mode, the composition control unit 247 adopts 
the second principle and first instructs the block 
reading unit 244 to selectively read only header blocks 

15 and audio blocks from DV data stored in the receiving 
buffer 225 in relation to frame n to be reproduced (see 
Fig. 26A) . 

Then, the block reading unit 244 reads audio 
blocks stored in the receiving buffer 225 and stores 
20 the blocks in a corresponding storage place of the 
second buffer of the composition buffer 245, as shown 
by attaching symbols a n and FH n . 

Then, the composition control unit 247 
designates both the header block and audio block and 
25 instructs the data replacement process of the DV data 
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editing unit 246. Then, the DV data editing unit 246 
replaces a frame header and an audio block, respectively, 
stored in the first buffer of the composition buffer 
245, which are shown by attaching symbols FH n _i and a n -i 
5 and by netting, with corresponding information stored 
in the second buffer, and the transmitting data, as 
shown in Fig. 26C can be obtained. 

If a transmission mode is a "picture only" mode, 
similarly, both a frame header and video blocks are 
10 replaced, and transmitting data are composed. 

In this way, depending on a transmission mode, 
each unit of the DV data reproduction unit 227 operates 
to reproduce an IEEE1394 packet string very close to 
the IEEE1394 packet string composing the original frame 
15 and to transmit the reproduced packet string to the 
second network via the IEEE1394 adapter 411 even if 
the relay device 210 on the transmitting side transmits 
only audio blocks or only video blocks. 

Next, a method for controlling the 
20 transmitting/receiving operation of a DV/IP packet by 
transmitting/receiving a control packet is described. 

Fig. 27 shows the transmitting/receiving 
operation . 

In Fig. 27, a DV/IP transmitting/receiving unit 
25 comprises the DV/IP transmitting unit 250, DV/IP 
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receiving unit 260 and Internet adapter 413 shown in 
Fig. 20. 

As described above, prior to the transmission 
of a DV/IP packet, the mode control unit 259 of the 
5 IP transmitting control unit 252 shown in Fig. 21 
calculates suitable transmission rate Rl based on mode 
information Ml stored in the mode information storage 
unit 257 and notifies the Internet adapter 413 of the 
rate . 

10 Therefore, in this case, DV data edited by the 

transmitting data editing unit 258 are re-edited as 
a DV/IP packet string by the DV/IP transmitting unit 
250 depending on a transmission mode indicated by mode 
information Ml, and the Internet adapter 413 transmits 

15 the data to the Internet at transmission rate Rl . 

In this case, for example, as shown in Fig. 27, 
a transmit instruction is inputted to the control packet 
processing unit 251 on the receiving side. If it is 
instructed that the receiving state of the self-device 

20 should be reported to the transmitting side, the 
management information collecting unit 255 operates 
to collect arrival management information from both 
the integrity judgment unit 261 and delay adjustment 
unit 262 according to instructions from the instruction 

25 analysis unit 254. 
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In this case, the management information 
collecting unit 2 55 receives a variety of counter values 
stored for each frame in the block counter unit 242 
provided, for example, in the integrity judgment unit 
5 261, also receives both arrival information and 
information about a frame to be reproduced from the 
delay adjustment unit 262, processes these pieces of 
information, as required, and generates arrival 
management information . 

10 Then, the control packet generation unit 256 

generates a control packet, including the arrival 
management information collected by the management 
information collecting unit 255 as control information, 
the DV/IP transmitting unit 250 incorporates the 

15 control packet into a DV/IP packet and the Internet 
adapter 413 transmits the packet to the relay device 
250 on the transmitting side via the Internet. 

If the DV/IP packet, including a control packet 
described above is inputted, the packet sorting unit 

20 263 shown in Fig. 23 transfers control information 
included in the payload of the DV/IP packet to the 
control information analysis unit 253 of the control 
packet processing unit 251 (see Fig. 27). 

Then, the control information analysis unit 253 

25 analyzes arrival management information included in 
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the control information received from the packet 
sorting unit 263 and, as shown in Fig. 21, it transmits 
an obtained analysis result to the mode control unit 
259 of the IP transmitting control unit 252 (see Fig. 
5 27) . 

The mode control unit 259 generates appropriate 
mode information M2 based on this analysis result, and 
rewrites the content of a mode information storage unit 
257. Simultaneously, a mode control unit 25 9 calculates 

10 transmission rate R2 suitable for the newly obtained 
mode information M2 and designates the new transmission 
rate R2 to the Internet adapter 413. 

In this way, the transmission rate of a DV/IP 
packet to be transmitted can be dynamically modified 

15 in the relay device 250 on the transmitting side, based 
on arrival management information about arrival state 
in the relay device 260 on the receiving side, and the 
transmission/reception of digital video data can be 
continued at a transmission rate practical in a 

20 transmission route, including the Internet. 

Furthermore, the address table of a switch and 
hub existing in a communications route can be updated 
and the network address of the relay device 210 on the 
transmitting side can be registered by transmitting 

25 a control packet from the relay device 220 on the 
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receiving side as described above* 

For example, the relay device 220 on the receiving 
side regularly updates the address table of 
communications equipment, such as a switch, a hub, etc . , 
5 by transmitting a DV/IP packet, including the control 
packet described above. 

In this way, even if communications equipment, 
such as a switch, a hub, etc., has a function to regularly 
delete the network address of an address table, the 

10 network address corresponding to the relay device 210 
on the transmitting side can be always registered in 
the address table. 

As described above, if a large number of DV/IP 
packets are transmitted from the relay device 210 on 

15 the transmitting side to the relay device 220 on the 
receiving side, there is the possibility that a large 
number of DV/IP packets may be lost if the network 
address of an address table is temporarily deleted in 
communications equipment , such as a switch, a hub, etc., 

20 existing in a transmission route , Therefore, a function 
to maintain the network address of an address table 
by transmitting/receiving the control packet 
described above has a great practical effect. 

Alternatively, the relay devices 210 and 220 can 

25 be controlled by each other by transmitting/receiving 
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a control packet, including both a variety of commands 
to start /stop the transmission of a DV/IP packet f etc., 
and the replies between the relay device 210 on the 
transmitting side and the relay device 220 on the 
5 receiving side. 

Alternatively, the operation of the delay 
adjustment unit 262 of the relay device 260 on the 
receiving side can be controlled by the relay device 
250 on the transmitting side using this control packet . 

10 For example, if a transmit instruction is 

inputted to the control packet processing unit 251 of 
the relay device on the transmitting side shown in Fig. 
20 and this transmit instruction instructs that a delay 
amount on the receiving side should be modified, the 

15 instruction analysis unit 254 generates a control 
packet, including both a command to modify the delay 
amount and delay amount D2 after modification, as 
control information, using the function of the control 
packet generation unit 256. 

20 Both the DV/IP transmitting unit 250 and Internet 

adapter 413 transmit a control packet obtained in this 
way to the Internet as a DV/IP packet (see Fig. 27) 
and the DV/IP transmitting/receiving unit of the relay 
device on the receiving side receives them. 

25 In this case, the control information analysis 
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unit 253 of a control packet processing unit 251 
receives control information included in the control 
packet described above from the packet judgment unit 
263 shown in Fig. 24 (see Fig. 27) and transfers both 
5 the command and delay amount D2 to the instruction 
analysis unit 254. 

Then, the instruction analysis unit 254 
designates new delay amount D2 and instructs the delay 
amount update unit 267 of a delay adjustment unit 262 

10 to modify the delay amount- Then, the delay amount 
update unit 267 updates the content of a delay amount 
storage unit 249 using the designated delay amount D2 . 

Since the delay adjustment unit 262 can 
dynamically modify a delay amount to be used to 

15 determine a frame to be reproduced in this way, transfer 
delay between the transmitting and receiving sides can 
be set to an appropriate value depending on an actual 
transmission condition . 

If a function to calculate appropriate delay 

20 amount Dx based on arrival management information 
collected as described above is provided in the relay 
device 220 on the receiving side and this new delay 
amount Dx is stored in the delay amount storage unit 
249 using the function of the delay amount update unit 

25 267, the relay device 220 on the receiving side can 
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autonomously control transfer delay. 

Alternatively, the operator of the relay device 
220 on the receiving side can designate an appropriate 
delay amount and can instruct the modification of the 
5 delay amount. Then, the delay amount update unit 2 67 
can update the delay amount. 

Alternatively, one relay device (for example, 
the relay device 210 shown in Fig . 11) can be exclusively 
used as a server and the other relay device (for example, 
10 the relay device 220 shown in Fig . 11) can be exclusively 
as a client. 

For example, it is configured that the relay 
device on the server side comprises an IEEE1394 adapter 
411, an Internet adapter 413 and a DV/IP transmitting 
15 unit 211 and the relay device on the client comprises 
an IEEE1394 adapter 411, an Internet adapter 413 and 
a DV/IP receiving unit 221. 

If the minimum required functions are provided 
in both the relay device exclusively used as a server 
20 and the relay device exclusively used as a client, a 
control packet can be transmitted/ received between the 
respective relay devices on the server and client sides . 

In this case, for example, the relay device on 
the server side comprise the decapsulation unit 222, 
25 additional information analysis unit 223 and packet 
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sorting unit 263 that are provided in the DV/IP 
receiving unit 260 as means for performing the minimum 
functions required to receive a DV/IP packet, and a 
DV/IP packet, including a control packet, is 
5 transferred to the control packet processing unit 251 
using the functions of these units. 

The relay device on the client side comprises, 
for example, the encapsulation unit 212 as means for 
performing the minimum functions required to transmit 

10 a DV/IP packet, and the encapsulation unit 212 generates 
a DV/IP packet, including a control packet generated 
by the control packet processing unit 251. 

The application scope of the present invention 
is not limited to the preferred embodiments described 

15 above. 

The data communications system of the present 
invention is applicable to all data communications 
system for relaying data between two networks that 
target data with a prescribed cyclical structure, via 

20 another network. 

Each of the communications quality compensation 
technology and delay adjustment technology that are 
described in the preferred embodiments given above is 
also independently applicable or a plurality of the 

25 techniques described in the individual preferred 
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embodiments can also be combined, if required. 

Fig . 28 shows the basic configuration of the fifth 
preferred embodiment of the present invention. 

According to this preferred embodiment, in a data 
5 communications system in which a transfer unit of a 
prescribed format transferred in the first network, 
which is one of a plurality of physically independent 
networks is relayed by transmitting side relay means 
510 installed in relation to the first network, another 

10 relay network and receiving side relay means installed 
in relation to the second network, which is at least 
one of other independent networks, the transmitting 
side relay means 510 comprises extraction means 511 
for extracting a transfer unit to be transmitted to 

15 the second network, transformation means 512 for 
applying a prescribed operation to control information 
included in the extracted transfer unit and generating 
a relay transfer unit , reshaping means 513 for reshaping 
the relay transfer unit into a packet in a format based 

20 on the transmitting procedures of the relay network 
and addressed to the receiving side relay device 
installed in relation to the second network and first 
transmitting means 514 for transmitting each packet 
reshaped by the reshaping means 513 to the relay network 

25 The receiving side relay mans 520 comprises separation 
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means 521 for separating the relay transfer unit by 
breaking down a packet received via the relay network, 
generation means 522 for applying a prescribed 
operation to the relay transfer unit obtained by 
5 separation means 521 and regenerating a transfer unit, 
including control information suitable for the 
transmitting process of the second network and second 
transmitting means 523 for transmitting the transfer 
unit generated by the generation means 522 tothe second 

10 network. 

According to this preferred embodiment, in the 
transmitting side relay means 510, since both 
transformation means 512 and reshaping means 513 
operate to encapsulate a relay transfer unit , including 

15 desired information as control information, into a 
packet suitable for a relay network when receiving the 
transfer unit from the extraction means 511 and to 
transmit the packet to the relay network via the first 
transmitting means 514. 

20 In the receiving side relay means 520, both the 

separation means 521 and generation means 522 operates 
to regenerate a transfer unit, including control 
information suitable for the second network when 
receiving the packet encapsulated as described above 

25 and to transmit the transfer unit to the second network 
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via the second transmitting means 523. 

Since in this way, control information required 
to control functions peculiar to the second network 
can be generated using control information on the first 
5 network side, data can be transferred theoretically 
in one network, including the functions peculiar to 
each network, regardless of the physical locations of 
the first and second networks. 

In the data communications system, the 

10 trans formation means 512 of the transmitting side relay 
means 510 can further comprises a first rewriting means 
for rewriting at least a part of control information 
included in each transfer unit and outputting the 
transfer unit as a relay transfer unit. 

15 In this case, since the first rewriting means 

531 of the transformation means 512 rewrites at least 
a part of control information into appropriate 
information, the operation of the generation means 522 
of the receiving side relay means 520 can be simplified. 

20 In the data communications system, each transfer 

unit transferred in the first and second networks 
includes time information required to keep a transfer 
operation synchronized as a part of control information 
The first rewriting means 531 can replace time 

25 information included in each transfer unit with invalid 
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data that are neglected when they are transferred to 
the second network. 

In this case, since the first rewriting means 
531 of the transformation means 512 rewrites in advance 
5 time information included in control information into 
invalid information, the generation means 522 of the 
receiving side relay means 520 can incorporate 
appropriate time information into a desired transfer 
unit . 

10 In the data communications system, the 

generation means 522 of the receiving side relay means 
520 can further comprise a second rewriting means 541 
for rewriting at least a part of control information 
included in each relay transfer unit and outputting 

15 the transfer unit as a transfer unit to be transmitted 
to the second network. 

In this case, since the second rewriting means 
541 of the generation means 522 rewrite at least a part 
of control information included in each relay transfer 

20 unit, control information valid in the second network 
can be surely generated, regardless of the content of 
control information in the first network. 

In the data communications system, each transfer 
unit transferred in the first and second networks 

25 includes time information required to keep transfer 
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operations synchronized as a part of control 
information, and the second rewriting means 541 can 
replace information about a transmission time included 
in the control information with time information valid 
5 in the network on the self-device side. 

In this case, since control information, 
including time information valid in the second network 
can be obtained by the second rewriting means 541 of 
the generation means 522, the synchronization of 

10 transfer operations can be maintained by using a time 
independent from the first network as a reference. 

In the data communications system, each transfer 
unit transferred in the first and second networks 
includes channel identification information about a 

15 transmission route as a part of control information. 
The generation means 522 comprises a storage means 542 
for storing information about the correspondence 
between channel identification information assigned 
in the first network and channel identification 

20 information assigned in the second network, in each 
communications conducted between a node belonging to 
the first network and a node belonging to the second 
network via a relay network. The second rewriting means 
541 rewrites channel identification information 

25 included in a relay transfer unit based on the 
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correspondence information . 

In this case, since correspondence information 
is stored in the storage means 542 of the generation 
means 522 and the second rewriting means 541 operates 
5 based on this correspondence information, channel 
numbers in the first network and channel numbers in 
the second network can be independently managed. 

In the data communications system, each transfer 
unit transferred in the first and second networks 

10 includes prescribed fixed information in each 
transmission route as a part of control information. 
The generation means 512 of the transmitting side relay 
means 510 comprise deletion means 532 for deleting the 
fixed information and outputting the transfer unit as 

15 a relay transfer unit. The generation means 522 of the 
receiving side relay means 520 comprises addition means 
543 for attaching fixed information as a part of control 
information corresponding to each relay transfer unit 
and outputting the transfer unit as a transfer unit 

20 to be transmitted to the second network. 

In this case, since fixed information included 
in a transfer unit is deleted by the deletion means 
532 of the transformation means 512, a data amount to 
be transmitted to a relay network by the first 

25 transmitting means 514 can be reduced. 
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However , when the transfer unit without the fixed 
information is inputted, the addition means 543 of the 
generation means 522 operates to attach the fixed 
information deleted by the transmitting side relay 
5 means and to regenerate a transfer unit I a format 
suitable for the second network. 

Fig . 2 9 shows the basic configuration of the sixth 
preferred embodiment of the present invention. 

In a data communications system, a series of 

10 transfer units transferred in the first and second 
networks are composed of valid transfer units, 
including information to be transferred and empty 
transfer units, including no information to be 
transferred. The reshaping means 513 of the 

15 transmitting side relay means 510 comprises first 
selection means 53 3 for selecting a valid transfer unit , 
including information to be transferred, as a target 
to be transmitted to a relay network and conversion 
means 534 for converting the transfer unit selected 

20 as a transmission target into a packet suitable for 
the relay network. 

In this case, since only valid transfer units 
are encapsulated and provided for the transmitting 
process of the transmitting means 514 by both the first 

25 selection means 533 and conversion means 534 of the 
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reshaping means 513 , a data amount to be transmitted 
to a relay network can be reduced as a whole. 

In the data communications system, the second 
transmitting means 52 3 of the receiving side relay means 
5 520 comprises transmitting means 544 for transmitting 
a transfer unit received as a transmission target to 
the second network and insert! on means 544 forinserting 
an empty transfer unit f including no information to 
be transferred, in a series of transfer unit strings 

10 received from the generation means 522 according to 
prescribed rules and inputting the transfer unit to 
the transmitting means 544 as a transfer unit to be 
transmitted. 

In this case, the series of transfer unit strings 

15 can be regenerated according to the prescribed rules 
by the insertion means 545 of the second transmitting 
means 523 and can be transmitted to the second network 
via the transmitting means 544. 

In this way, a transfer unit string in which an 

20 empty transfer unitisinsertedatan appropriate timing 
can be regenerated and the timing adjustment of 
synchronous transfer operations on the second network 
side is possible. 

In the data communications system, a series of 

25 transfer units transferred in the first and second 
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networks are composed of valid transfer units, 
including information to be transferred and empty 
transfer units, including no information to be 
transferred. The reshaping means 513 of the 
5 transmitting side relay means 510 comprises second 
selection means 535 for selecting all the transfer units 
or valid transfer units, including information to be 
transferred as transmission targets and conversion 
means 534 for converting the transfer units selected 

10 as transmission targets into a packet suitable for a 
relay network. 

In this case, when a select instruction is 
inputted, the second selection means 535 of the 
reshaping means 513 operates to input all the transfer 

15 units or valid transfer units to conversion means 534, 
if required. 

In the data communications system, the reshaping 
means 513 of the transmitting side relay means 510 
comprises third selection means 535 for identifying 

20 a correct transfer unit that satisfies the conditions 
to be met by a transfer unit in the first network and 
selecting the transfer unit as a target to be 
transmitted to a relay network and conversion means 
534 for converting the transfer units selected as 

25 transmission targets into a packet suitable for the 
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relay network. 

In this case, only correct transfer units meeting 
prescribed conditions can be selectively encapsulated 
by both the third selection means 536 and conversion 
5 means 534 and can be transmitted to a relay network 
via the first transmitting means 514. 

Fig. 30 shows the basic configuration of the 
seventh preferred embodiment of the present invention . 

The data communications system is configured so 

10 that the first and second networks can select a route 
node from nodes belonging to the network according to 
prescribed procedures when a prescribed operation is 
performed and that this route node can manage 
transmission in the network. Each of the transmitting 

15 relay means 510 and receiving side relay means 520 
comprises judgment means 515 for judging whether the 
self-device is designated as a route node when a 
prescribed operation is performed, and reset means 516 
for performing the prescribed operation if the j udgment 

20 means 515 judges that the self-device is a route node. 

In this case, either of the transmitting side 
relay means 510 and receiving side relay means 520 can 
be prevented from becoming a route node by both the 
judgment means 515 and reset means 516 when the 

25 prescribed operation is performed. 
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The data communications system is configured so 
that the first network can confirm the delivery of an 
asynchronous transfer unit from time to time 
transmitted from each node to another node, both of 
5 which belong to the network, by a prescribed reply 
transfer unit. The transmitting relay means 510 
comprises a reply acting means 517 for returning the 
prescribed relay transfer unit to the originating node 
of the asynchronous transfer unit when the asynchronous 

10 transfer unit is extracted by the extraction means 511 . 

In this case, since the reply acting means 517 
of the transmitting side relay means 510 operates to 
return the prescribed relay transfer unit to the 
originating source instead of a node belonging to the 

15 second network, the delivery confirming operation in 
the first network can be normally completed, regardless 
of both a physical distance with the second network 
and transfer delay due to passing through a relay 
network . 

20 The data communications system is configured so 

thateachofa plurality of independent networks assigns 
a node number to each node belonging to the network 
when a prescribed operation is performed. The 
transmitting side relay means 510 comprises first 

25 number storage means 518 for storing the correspondence 
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between both identification information peculiar to 
each node belonging to the first network and constant 
virtual number, and the node number assigned in the 
first network, and first number update means 519 for 
5 collecting node numbers assigned to each node in the 
first network when the prescribed operation is 
performed and updating the content of the first number 
storage means 518. The transformation means 512 
replaces a node number included in the extracted 

10 transfer unit by the extract ion means 511 as information 
about transmitting source, with a corresponding 
virtual node stored in the first number storage means 
518 . The receiving side relaymeans 520 comprises second 
number storage means 524 for storing the correspondence 

15 between both identification information peculiar to 
each node belonging to the second network and constant 
virtual number, and the node number assigned in the 
second network and second number update means 525 for 
collecting node numbers assigned to each node in the 

20 second network when the prescribed operation is 
performed and updating the content of the second number 
storage means 524. The generation means 522 replaces 
the virtual node number included in the relay transfer 
unit as information about a destination, with a 

25 corresponding node number stored in the second number 
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storage means 524. 

In this case, when the prescribed operation is 
operated, the contents of the first number storage means 
518 and second number storage means 524 are updated 
5 every time a new node number is assigned to each node 
belonging to the first network and each node belonging 
to the second network, respectively, and are provided 
for the processes of the transformation means 512 and 
generation means 522 , respectively, by the first number 

10 update means 519 of the transmitting side relay means 
510 and the second number update means 525 of the 
receiving side relay means 520, respectively. 

Therefore, if a destination node belonging to 
the second network is designated using a virtual node 

15 number, the virtual node number can be surely replaced 
with a node number assigned to a corresponding node 
in the second network by a replacement process performed 
by the generation means 522 of the receiving side relay 
means 520. Therefore, a transfer unit can be surely 

20 delivered to the destination node, regardless of the 
modification of a node number in the second network. 

In this case, if a node number for indicating 
a transmitting source is replaced with a virtual node 
number by the transformation means 512 of the 

25 transmitting side relaymeans 510, correct information 
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about a transmitting node belonging to the first network 
on the transmitting side can be delivered to a 
destination node belonging to the second network on 
the receiving side. 
5 Fig. 31 shows the configuration of the preferred 

embodiment of the data communications system of the 
present invention . 

In Fig. 31, each of relay devices 610s and 610r 
comprises an IEEE1394 adapter 611 corresponding to the 

10 IEEE1394 adapter 411 shown in Figs. 6A through 6C f and 
the relay devices 610s and 61 Or are connected to a serial 
bus composing the first network and a serial bus 
composing the second network, respectively. 

In the following description, when the relay 

15 devices 610s and 610r are called together, a relay 
device 610 is simply used. 

In this relay device 610, a transmitting packet 
editing unit 612 edits control information included 
in an IEEE1394 packet received from an IEEE1394 adapter 

20 611 as described later and generates a relay packet. 

In Fig. 31, an encapsulation unit 613 receives 
a relay packet generated by the transmitting packet 
editing unit 612 and encapsulates this packet according 
to IP protocol or UDP/IP protocol, and an IP packet 

25 (or UDP/IP packet) obtained in this way is transmitted 
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to the Internet via the Internet adapter 413. 

In this case, if an IEEE1394 packet to be relayed 
is in a synchronous mode, the relay packet is 
encapsulated according to UDP protocol. If it is in 
5 an asynchronous transfer mode, the packet is 
encapsulated according to TCP protocol. 

In the relay device 610 shown in Fig. 31, a 
decapsulation unit 621 decapsulates the IP packet 
received from an Internet adapter 713 and separates 
10 the relay packet. 

The receiving packet editing unit 622 shown in 
Fig. 31 edits control information that is included in 
the relay packet separated by the decapsulation unit 
621 as described later and generates an IEEE1394 packet 
15 suited to be transferred in the second network. The 
regenerated IEEE1394 packet is transmitted to the 
second network via the IEEE1394 adapter 611. 

Fig. 32 shows the relay operation of an IEEE1394 
packet . 

20 In the IEEE1394 adapter 612 shown in Fig. 32, 

an interface (I/F) control unit 614 controls the 
operation of an IEEE1394 interface (I/F) 616 based on 
filter information stored in a filter information 
storage unit 615 and extracts IEEE1394 packets to be 

25 relayed from IEEE1394 packets transmitted via a 
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connected serial bus, in addition to IEEE1394 packets 
addressed to the self-device. 

For example, filter information, including both 
a node ID for indicating a digital video deck (see Fig. 
5 31), which is one of nodes belonging to the second 
network and a channel ID for indicating aisochronous 
channel that the digital video deck 704b is to receive 
is generated in advance, in addition to both a node 
ID for indicating the self-device and a channel ID 

10 required by the self-device and is stored in a filter 
information storage unit 615. 

In the transmitting packet editing unit 612 shown 
in Fig. 32, a control information editing unit 617 edit s 
the designated field of the IEEE1394 packet received 

15 from the IEEE1394 adapter 611 according to edit 
instructions. A transmitting side control unit 618 
generates an edit instruction on a necessary editing 
process based on the content of the inputted IEEE1394 
packet and inputs the instruction to a control 

20 information editing unit 617. 

A relay packet obtained as the editing result 
of this control information editing unit 617 is 
encapsulated by an encapsulation unit 613 and is 
transferred to the relay device 620 on the receiving 

25 side. 
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In Fig. 32 , an interface with the Internet is 
omitted. 

In the receiving packet editing unit 622 shown 
in Fig. 32, a synchronous information generating unit 
5 623 operates according to an instruction from the 
receiving side control unit 624 to generate information 
elements to be included in a synchronous packet as 
control information and to return the elements to the 
receiving side control unit 624. 

10 In this synchronous information generating unit 

62 3 r a channel ID reading unit 625 reads a corresponding 
channel ID on the receiving side from a channel ID table,, 
which is described later, based on a channel ID 
designated by an instruction from the receiving side 

15 control unit 624. A time stamp generation unit 628 
generates a time stamp for indicating a time valid in 
the second network as described later according to 
instructions from the receiving side control unit 624. 

Both the channel ID obtained by this channel ID 

20 reading unit 625 and the time stamp obtained by the 
time stamp generation unit 628 are transferred to the 
receiving side control unit 624 as information elements 
to be included in a synchronous packet as control 
information . 

25 In Fig. 32, a channel ID collection unit 627 
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collects a channel ID for indicating an aisochronous 
channel assigned to communications to be relayed by 
the relay devices 610s and 610r on the second network 
side, if required, and updates the content of a channel 
5 ID table 226. 

Next, the operation of relaying an IEEE1394 
aisochronous packet (hereinafter called a 
"synchronous packet") transferred through a serial bus 
composing the first network to the second network is 

10 described with reference to Figs. 31 and 32. 

Fig. 33 also shows both the transformation and 
regeneration processes of a synchronous packet. 

An interface control unit 614 controls the 
operation of an IEEE1394 interface 616 based on the 

15 filter information stored in the filter information 
storage unit 615 shown in Fig. 32, and the synchronous 
packet of a corresponding aisochronous channel is 
extracted and is transferred to the transmitting packet 
editing unit 612. 

20 For example, if an aisochronous channel 

indicated by channel ID "SI" in the first network is 
assigned to communications to be relayed and a valid 
time stamp is attached to the third synchronous packet 
from the head of one frame, as shown in Fig. 33A, the 

25 synchronous packet includes the channel ID "Si" 
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described above as the value of the corresponding field 
of a synchronous header composing each synchronous 
packet, and the third synchronous packet of each frame 
includes the valid value "TS1" as the value of the time 
5 stamp field of a CIP header. 

In this case, a control information editing unit 
617 rewrites the content of a time stamp field in a 
CIP header included in a synchronous packet, into a 
prescribed value (for example, a value expressed by 
10 hexadecimal number "FFFF" that is invalid as a time 
stamp) . 

In this way, the contents of time stamp fields 
that are included in all the packets transferred in 
the aisochronous channel described above are replaced 

15 with an invalid value, regardless of whether a time 
stamp that is included in a synchronous packet received 
from an IEEE1394 adapter 611 is valid (see Fig. 33B) . 

Then, a UDP header for designating a network 
address for indicating the relay device 610s on the 

20 transmitting side and a network address for indicating 
the relay device 610r on the receiving side as 
originating source and a destination, respectively, 
is attached to a series of synchronous packets, 
including this invalid value as a time stamp by the 

25 encapsulation unit 613 and are transmitted to the 
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Internet as UDP/IP packets* 

On receipt of the series of UDP/IP packets via 
the Internet adapter 713, the decapsulation unit 621 
eliminates the UDP header from each UDP/IP packet and 
5 transfers the obtained synchronous relay packets to 
a receiving packet editing unit 622. 

Then, the receiving side control unit 624 judges 
whether each synchronous packet is located at the head 
of a frame in digital video data, for example, based 

10 on a value that is expressed by the first three bytes 
of digital video data included in the received 
synchronous packet and designates a field to be 
rewritten for the control information editing unit 617 
based on this judgment result. 

15 If the relevant synchronous packet is located 

at the head of a frame, the receiving side control unit 
624 instructs a control information editing unit 617 
to rewrite a time stamp field included in a CIP header 
as well as a channel ID field included in a synchronous 

20 header and also instructs both a channel ID reading 
unit 624 and time stamp generation unit 628 that are 
provided in a synchronous information generating unit 
623 to generate respective corresponding information 
elements . 

25 In this case, if the two relay devices shown in 
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Fig. 31 relay data communications between a digital 
video camera 703a belonging to the first network and 
a digital video deck 704b belonging to the second 
network, the channel ID for indicating an aisochronous 
5 channel that the relay device 610 on the second network 
side has obtained for this communication (shown by 
attaching symbol Rl in Fig. 31) is stored in the channel 
ID table 626 in relation to a channel ID for indicating 
an aisochronous channel assigned to the digital video 

10 camera 703a (shown by attaching symbol SI), as shown 
in Fig. 34A. 

In this case, the channel ID reading unit 625 
receives the channel ID of the transmitting side 
included in a relay packet, from the receiving side 

15 control unit 624 and obtains information elements to 
be included in a synchronous packet activated in the 
second network as control information by retrieving 
the channel ID of the receiving side corresponding to 
this channel ID from the channel ID table 626. 

20 Since the relay device 620 starts to relay 

synchronous packets via the Internet and restarts the 
relay by bus reset, a channel ID collection unit 627 
receives the relevant channel ID from the IEEE1394 
adapter 611 and stores the channel ID in the channel 

25 ID table 626 in relation to a channel ID included in 
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a synchronous packet to be relayed, when obtaining the 
aisochronous channel in the second network. 

For example, a time stamp generation unit 628 
receives information about a reference time in the 
5 second network from the IEEE1394 adapter 611 and 
transfers a value obtained by adding a constant 
corresponding to a prescribed time to this reference 
time information, to the receiving side control unit 
224 as a time stamp for indicating a timing when the 

10 relevant synchronous packet is outputted to the serial 
bus on the second network side, according to 
instructions from the receiving side control unit 624 . 

Then, the receiving side control unit 624 inputs 
the channel ID of the receiving side described above 

15 and this time stamp, to the control information editing 
unit 617 as editing information about a channel ID field 
and a time stamp field, respectively. 

If a synchronous packet is located at a place 
other than the head of a frame is inputted, the receiving 

20 side control unit 624 Inputs the channel ID obtained 
from the channel ID reading unit 625 to the control 
information editing unit 617 and rewrites only a channel 
ID field. 

In this way, both the synchronous information 
25 generating unit 623 and control information editing 
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unit 617 operates according to instruction from the 
receiving side control unit 624, and, as shown in Fig. 
33C, the channel ID field of each synchronous packet 
relayed via the Internet and the time stamp included 
5 in the synchronous packet located at the head of a frame 
can be replaced with channel ID "Rl" and time stamp 
"TS2", respectively. 

The synchronous packet obtained in this way is 
equivalent to that outputted to a serial bus by a node 

10 belonging to the second network. 

Specif ically, according to a data communications 
system with the relay device 610 described above, 
packets can be transferred in an IEEE1394 synchronous 
mode theoretically regarding two different networks 

15 as one network although both an aisochronous channel 
and a system clock are independently managed in the 
first and second networks. 

Since a channel ID is independently managed on 
the transmitting and receiving sides, a channel ID can 

20 be freely attached in either of the first network, which 
is a transmitting side, and the second network, which 
is a receiving side, regardless of whether 
communications are conducted within one network and 
thereby the management of channel IDs can be simplified. 

25 For example, if the channel ID on the receiving 
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side is modified by bus reset made in the second network 
on the receiving side, communications can be maintained 
without any influence on the transmitting side. 

Similarly, a synchronous packet outputted to a 
serial bus by the digital video camera 703b belonging 
to the second network shown in Fig. 31 can also be 
transferred to the digital video deck 794a belonging 
to the first network. 

As shown in Fig. 35, two-way data communications 
can also be conducted among three or more networks with 
the relay device 610. 

In this case, channel IDs on the receiving side 
are stored in advance in the channel ID table 625 of 
the receiving packet editing unit 622 (see Fig. 32) 
15 in relation to the combination of a channel on the 
transmitting side and a network address provided to 
the relay device on the transmitting side (shown by 
attaching symbols "Nl" and "N2" in Figs. 34A and 34B) , 
as shown in Fig. 34B. For example, the synchronous 
20 information generating unit 623 receives the network 
address of the relay device on the transmitting side 
from the decapsulation unit 621, retrieves data from 
the channel ID table 625 based on both the network 
address and a channel ID included in a relay packet 
25 and generates editing information using the obtained 
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channel ID. 

Alternatively , a time stamp field included in 
a packet located at the head of a frame can be replaced 
with a valid value by the receiving packet editing unit 
5 622, and the time stamp field of another packet can 
be replaced with an invalid value instead of the 
transmitting packet editing unit 612 replacing a time 
stamp with an invalid value. 

In this way, since the relay device 610 on the 

10 receiving side regenerates a series of synchronous 
packets in which only a time stamp attached to the 
leading packet of a frame has a valid value, regardless 
of the position in a frame of a synchronous packet with 
a valid time stamp of a series of packets transferred 

15 in the first network, a node on the receiving side that 
belongs to the second network can be prevented from 
operating wrong. 

The data communications system of the present 
invention can be applied not only to the case where 

20 data are transferred in the IEEE1394 synchronous mode 
described above, but can also be applied to all data 
communications systems in which networks for 
transferring packets in a prescribed form in a 
transmission route that can be specified by information 

25 equivalent to an channel ID are connected via another 
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network. 

Next, a technology for reducing an information 
amount to be relayed by both relay devices and the 
Internet as a whole in the case where a large number 
5 of packets in a specific format are consecutively 
relayed, such as the transfer operation of synchronous 
packets in an IEEE1394 synchronous mode, is described. 

Fig. 36 shows the basic configuration of a data 
communications system. 
10 In the transmitting packet editing unit 612 shown 

in Fig. 36, a relay target identification unit 631 
identifies synchronous packets to be relayed to the 
second network under conditions stored in a condition 
storage unit 632, and the synchronous packets 
15 identified to be relayed by this relay target 
identification unit 631 are inputted to the control 
information editing unit 617 . 

A discard judgment unit 633 judges whether a 
synchronous header included in a synchronous packet 
20 can be omitted, and this judgment result is inputted 
to the transmitting side control unit 618. 

In the encapsulation unit 613 shown in Fig. 36, 
a header addition unit 634 generates a UDP/IP packet 
by generating an appropriate UDP header based on address 
25 information stored in an address management table 635 
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and attaching the header to a synchronous packet 
received from the transmitting packet editing unit 612 . 

In the receiving packet editing unit 622 shown 
in Fig. 36, a header reproduction unit 636 receives 
5 a network address for indicating the relay device 610s, 
which is a transmitting source, from the decapsulation 
unit 621 and reproduces the synchronous header as 
described later, based on this network address. 

The synchronous header reproduced by this header 
10 reproduction unit 636 is inputted to the receiving side 
control unit 623. 

In Fig. 36, an empty packet insertion unit 637 
generates an empty packet in a format specified by the 
standard of an IEEE1394 synchronous mode and inserts 
15 the empty packet inthe string ofaseriesof synchronous 
packets, the editing process of which have been 
completed by the control information editing unit 617 . 
A series of synchronous packets, including the empty 
packet regenerated in this way are outputted to the 
20 serial bus of the IEEE1394 adapter 611. 

In Fig. 36, a transmission route that a UDP/IP 
packet generated by this encapsulation unit 613 follows 
is omitted since the route is the same as that shown 
in Fig. 31. 

25 The operation of omitting redundant information 
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included in a synchronous packet and preventing an 
incorrect packet from being transmitted by each unit 
shown in Fig. 36 is described below. 

Figs. 37A through 37D show the relay operation 
5 of a synchronous packet. 

Figs. 38 and 39 are a flowchart showing a 
transmitting packet editing operation and a flowchart 
showing a receiving packet editing operation, 
respectively . 

10 For example, if a transmitting node transmits 

one empty packet every time it transmits 15 synchronous 
packets, the synchronous packet string shown in Fig. 
37A are inputted to the relay target identification 
unit 631 of the transmitting packet editing unit 612 

15 via the IEEE1394 adapter 611 (step A301 show in Fig. 
38) . 

In Figs. 37A through 37D, valid synchronous 
packets, including video data to be transferred that 
are shown by symbols PI through P15 and empty packets 

20 are identified by data-length information that is 
included in a synchronous header attached to each packet 
(shown by painting in Fig. 37) . Since, as shown in Fig. 
5, the data length of a synchronous packet, including 
valid transfer information is fixed, it can be judged 

25 whether the synchronous packet is normal by comparing 
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the data length of an inputted synchronous packet with 
the data length of the correct synchronous packet. 

Therefore, for example, the condition storage 
unit 632 stores in advance a first condition that data 
5 length is eight bytes and a second condition that data 
length is over 250 bytes, as a condition for the 
specification of an empty packet and a condition for 
the specification of an incorrect packet, 
respectively . 

10 In this case, the relay target identification 

unit 631 first checks data length included in a 
synchronous header attached to an inputted synchronous 
packet, with the first condition. If the packet meets 
the condition, in step A302, the packet is judged to 

15 be empty and the transmitting packet editing process 
is terminated. 

If in step A302 the packet is not judged to be 
empty, the relay target identification unit 631 then 
checks the data length of the inputted synchronous 

20 packet with the second condition. If the packet meets 
the condition, the judgment in step A303 it becomes 
yes and the transmitting packet editing process is 
terminated . 

If the judgment in step A303 is be no, the relay 
25 target identification unit 631 inputs the inputted 
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synchronous packet to the control information editing 
unit 617 as a relay target, and then the generation 
operation of a relay packet is started. 

In this case, first, a discard judgment unit 633 
5 receives a channel ID included in the synchronous header 
of a synchronous packet to be relayed, from the 
transmitting side control unit 618 and judges whether 
communications can be uniquely specified on the 
receiving side based on this channel ID (step A304) . 

10 In this case, as shown in Fig. 5, the synchronous 

header attached to a synchronous packet consists of 
fixed information, such as data length, a synchronous 
code, etc., and only an channel ID differs for each 
communications . 

15 However, if an aisochronous channel to be relayed 

to the relay device 610r, which is a destination, is 
single, communications to be relayed can be uniquely 
specified by a network address for indicating the relay 
device, which is a transmitting source. Therefore, 

2 0 there is no need to notify the receiving side of a channel 
ID on the transmitting side. 

Especially, as described above , if the receiving 
packet editing unit 622 of the relay device 610r on 
the receiving side rewrites the content of a synchronous 

25 header attached to each synchronous packet, attaching 
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a synchronous header on the transmitting side does not 
mean nothing but to secure a field to be rewritten. 
Therefore, the synchronous header can be omitted. 

Therefore, if the judgment in step A304 is yes, 
5 the control information editing unit 617 discards a 
synchronous header attached to a synchronous packet 
according to an instruction from the transmitting side 
control unit 618 (step A3 05), then performs the editing 
process of a CIP header, such as rewriting of a time 

10 stamp field, etc., (stepA306) and transmits an obtained 
relay packet to the encapsulation unit 613 (step A307 ) . 

In this case, as shown in Fig. 37B, a relay packet 
string such that only a CIP header is attached to data 
main body with a prescribed data length is inputted 

15 to the encapsulation unit 613, each packet is 
encapsulated into a UDP/IP packet and the packet string 
is transmitted to the Internet. 

In this way, by eliminating an omissible 
synchronous header as well as an empty packet from 

20 information to be relayed, an information amount to 
be relayed via the Internet can be reduced as a whole 
without the loss of substantial information to be 
relayed to the receiving side. 

By eliminating incorrect synchronous packets, 

25 the data length of which exceeds a prescribed data 
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length, from information to be relayed, each node 
belonging to the second network on the receiving side 
can be prevented from operating wrong due to the input 
of an incorrect packet. 
5 If communications of a plurality of aisochronous 

channels is relayed to the same relay device 610r, the 
communications cannot be uniquely specified simply by 
the network address of the relay device 610s, which 
is a transmitting source. Therefore, the judgment in 

10 step A304it is no, and the flow proceeds to step A306 
with the synchronous header left as it is. 

Next, a method for regenerating a synchronous 
packet string in a format suitable for an IEEE1394 
synchronous mode from a relay packet obtained by 

15 eliminating omissible information as described above 
is described. 

As shown in Fig. 39, when a relay packet is 
inputted, the receiving side control unit 624 first 
j udges whether this relay packet includes a synchronous 

20 header (steps A311 and A312) . 

In this case, the receiving side control unit 
624 judges whether there is a synchronous header, for 
example, based on whether the leading two bytes of the 
relay packet indicates the data length of the 

25 synchronous packet. 
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In this case, however, a header reproduction unit 
636 receives the network address of a transmitting 
source from the decapsulation unit 621 and reproduces 
a synchronous header, including a channel ID valid on 
5 the receiving side based on both this network address 
and the channel ID table 626 (see Figs. 32, 34A and 
34B) of the synchronous information generating unit 
623. 

In this case, as shown in Fig. 34B, each 

10 communications is specified by the pair of the network 
address of a transmitting source and a transmitting 
channel, regardless of the number of networks via which 
a data communications system relays communications and 
a channel ID valid on the receiving side is stored for 

15 each communications. Then, the header reproduction 
unit 623 retrieves a corresponding channel ID of the 
receiving side from this channel ID table 625 based 
on the network address of a transmitting source, 
reproduces a synchronous header from both this channel 

20 ID and fixed information and transfers the header to 
the receiving side control unit 624. 

As shown in Fig. 37B, if a relay packet without 
the synchronous header is inputted and the judgment 
in step A3 12 becomes no, the control information editing 

25 unit 617 receives the synchronous header obtained by 
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the header reproduction unit 636 together with an 
instruction from the receiving side control unit 624 
and generates a synchronous packet based on the IEEE1394 
standard by attaching this synchronous header to the 
5 relay packet and performing a CI P header edit ing process , 
such as rewriting of a time stamp, etc. (steps A313 and 
314) . 

If the judgment in step A312 is yes, the control 
information editing unit 617 performs the editing 
10 process, such as writing of a channel ID, etc., of the 
synchronous header included in the relay packet 
according to instructions from the receiving side 
control unit 624 (stepA315) and then the flow proceeds 
to step A314 . 

15 After outputting the synchronous packet 

generated in this way to a serial bus via the IEEE1394 
adapter 611 (step A316) , the empty packet insertion 
unit 637 judges whether an empty packet should be 
inserted, based on the number of transmitted 

20 synchronous packets (step A317) . 

In this case, the empty packet insertion unit 
637 judges that Insertion timing arrives (Yes in step 
A317), outputs an empty packet (step A318) and then 
terminates the process, after transmitting the 

25 synchronous packet, located, for example, at the i-th 
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position from the head of a frame, and every time 
transmitting j synchronous packets after that. 

If the judgment in step A317 is no, the empty 
packet insertion unit 637 terminates the process. 

In this way, an empty packet can be inserted at 
timing suitable for the second network on the receiving 
side (for example, at the timing of following the 16 th 
synchronous packet) , regardless of the timing when the 
node of a transmitting source outputs an empty packet 
(see Fig. 37A) , as shown in Fig. 37D. In this way, a 
synchronous packet string equivalent to the 
synchronous packet string outputted by a node belonging 
to the second network can be generated and outputted 
to a serial bus. 

In this case, since the empty packet insertion 
unit 637 of the relay device 610r on the receiving side 
can freely determine the insertion timing of an empty 
packet, for example, the empty packet insertion unit 
637 can also insert an empty packet every time k 
synchronous packets are transmitted, regardless of the 
separation of frames . 

Alternatively, the system can be configured so 
that a select instruction can be inputted to the relay 
target identification unit 631 shown in Fig. 36 and 
the relay target identification unit 631 can identify 
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a relay target based on the first principle according 
to this selection instruction. 

In this case, for example, when a select 
instruction to ignore the first principle is inputted, 
5 the relay target identification unit 631 operates to 
judge that an empty packet outputted by a node on the 
transmitting side as well as the synchronous packet 
with a data section are judged to be relayed and is 
relayed via the Internet. 

10 In this way, if whether an empty packet should 

be inserted in a relay target or not can be selected 
according to a select instruction, the information 
amount of a relay target can be adjusted depending on 
the traffic of the Internet. 

15 Next, a method for implementing the transfer of 

a packet equivalent to IEEE1394 asynchronous 
communications among a plurality of networks located 
physically far away from one another is described. 

Fig. 40 shows the basic configuration of one 

20 preferred embodiment of the data communications 
system. 

In the IEEE1394 adapter 611 shown in Fig. 40, 
a reply generation unit 641 generates a reply packet 
in a prescribed format according to a reply instruction 
25 and outputs the packet to a serial bus via the IEEE1394 
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interface 616. 

In the relay device 610s shown in Fig, 40, apacket 
distribution unit 642 identifies the destination of 
asynchronous packets to be inputted, distributes the 
5 packets between a packet processing unit 643 and a 
transmitting packet editing unit 644 and inputs a reply 
instruction corresponding to the asynchronous packet 
distributed to the transmitting packet editing unit 
644 to the reply generation unit 641 described above. 

10 This transmitting packet editing unit 644 

rewrites both an originating node ID and a destination 
node ID that are included in an asynchronous packet 
received from the packet distribution unit 642 as 
described later based on node information, which is 

15 described later, stored in a node ID table 645s and 
generates a relay packet . This relay packet is inputted 
to an encapsulation unit 613. 

In each of the two relay devices 610s and 610r 
shown in Fig. 40, a node information collection unit 

20 646 collects node information about all the nodes 
belonging to a network to which the self-device is 
connected as described later and stores the node 
information in the respective node ID tables 645. 

In the relay device 610r shown in Fig. 40, the 

25 receiving packet editing unit 647 receives a relay 
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packet from the decapsulation unit 621, rewrites both 
the originating node ID and destination node ID included 
in this relay packet as described later, based on the 
node information stored in the node ID table 645r and 
5 generates an asynchronous packet suitable for the 
second network. 

In Fig. 40, a route judgment unit 648 judges 
whether the self-device (for example, relay device 
610r) is designated to be a route node, based on node 
10 information collected by a node information collection 
unit 646. A reset signal transmitting unit 649 outputs 
a prescribed reset signal to a serial bus via the 
IEEE1394 adapter 611 based on the judgment result that 
the self-device is designated to be a route node. 
15 Fig. 41 shows the detailed configurations of both 

the transmitting packet editing unit and receiving 
packet editing unit. 

In the transmitting packet editing unit 644 shown 
in Fig. 41, a virtual ID reading unit 651 reads an 
20 appropriate virtual ID, which is described later, from 
the node ID table 645 according to an instruction from 
the transmitting side control unit 618 and returns the 
ID to the transmitting side control unit 618. This 
virtual ID is transferred to the control information 
25 editing unit 617 via the transmitting side control unit 
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618 and is provided for the editing process of an 
asynchronous packet . 

Similarly, in the receiving packet editing unit 
647 shown in Fig. 41, a node ID reading unit 652 reads 
5 an appropriate node ID from the node ID table 645r 
according to an instruction from the receiving side 
control unit 624. This node ID is transferred to the 
control information editing unit 617via the receiving 
side control unit 624 and provided for the editing 

10 process of the relay packet. 

In Figs. 40 and 41, both the units related to 
the receiving function of the relay device 610s and 
the units related to the transmitting function of the 
relay device 610r are omitted. 

15 Next, the operations are described using as an 

example a case where an asynchronous packet is relayed 
from a node belonging to the first network (for example, 
the digital video camera 703 shown in Fig. 31) to a 
node belonging to the second network (for example, the 

20 digital video deck 704 shown in Fig. 31). 

To relay an asynchronous packet among a plurality 
of networks, the correspondence between information 
for absolutely identifying a node that participates 
in communication and information for identifying the 

25 node in the respective network to which the nodes belong 
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must be managed . 

This is because a node ID to be used to identify 
each node belonging to a network in each network may 
sometimes be modified when bus reset is made. 

In this case, in an asynchronous header included 
in a an asynchronous packet, each of a destination field 
for indicating a destination and a transmitting field 
for indicating a transmitting source is composed of 
both a bus ID field for indicating a network to which 
the relevant node belongs and a node ID field to be 
provided in the network. The bus ID is fixed, regardless 
of whether bus reset is made or not. 

Therefore, as shown in Fig. 42A, a virtual ID 
with a fixed value (shown by attaching symbols Snl 
through Snl4) is in advance provided to each node 
regardless of whether bus reset is made or not, and 
if both a transmitting source and a destination are 
indicated using this virtual ID instead of a node ID 
when an asynchronous packet is relayed among a plurality 
of networks, information for specifying both the 
destination and transmitting source can be surely 
delivered regardless of whether bus reset is made in 
each network . 

In this case, if each node is specified by the 
combination of a serial number, which is identification 
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information peculiar to each node, and the virtual ID 
and the correspondence between each node belonging to 
the network on the self-device side and a node ID 
assigned to the network (shown by a bracketed number 
5 in Fig. 42A) is stored in the node ID table 245 of the 
relay device 610 belonging to each network, both the 
information for absolutely identifying each node 
belonging to the respective network and information 
for identifying each node in the network can also be 

10 managed (see Figs. 42B and 42C) . 

In this case, destination information about each 
node belonging to the second network is also stored 
in a filter information storage unit 615 as the filter 
information of the IEEE1394 adapter 611 of the relay 

15 device 610s shown in Fig. 40 together with destination 
information about the self-device. 

Based on the filter information, an interface 
control unit 614 can also control the operation of the 
IEEE1394 interface 616 to receive an asynchronous 

20 packet, the destination of which is a node belonging 
to the second network as well as an asynchronous packet 
addressed to the self-device and to distribute the 
packet to the packet distribution unit 624. 

Next, the relay operation of an asynchronous 

25 packet using the virtual ID described above is 
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described . 

Figs. 43 and 44A through 44C show the relay 
operation of an asynchronous packet. 

For example, an asynchronous packet outputted 
5 to a serial bus addressed to a node belonging to the 
second network by a node belonging to the first network 
(shown as a transmitting node in Fig. 43) is inputted 
to a packet distribution unit 642 via the 1EEE1394 
interface 616 of the relay device 610s. 
10 In this case, as shown in Fig. 44A, the 

transmitting node designates virtual ID M Vr2" provided 
to the relevant node together with bus ID "B2" for 
indicating the second network as a destination field 
and designates node ID ' x l" as well as bus ID "Bl" for 
15 indicating the first network as a transmitting field 
for indicating the self. 

In this case, the packet distribution unit 642 
judges the distributing destination of the 
asynchronous packet based on information indicated in 
20 a destination field for indicating a destination 
attached to the asynchronous packet. 

As described above, if an asynchronous packet 
with a destination field, including a bus ID for 
indicating the second network is inputted, the packet 
25 distribution unit 642 judges that the packet should 



